Video collaboration tools

Abstract

A video collaboration tool is provided, which in some embodiments is characterized by a non-transitory machine-readable storage medium encoded with instructions executable by a hardware processor of a computing component, the machine-readable storage medium including instructions for causing the hardware processor to execute a method for an electronic device, the method comprising: repeatedly playing a video clip having a predetermined duration; capturing a video of a user of the electronic device while repeatedly playing the video clip; automatically generating multiple shots of the user's video, each shot having a predetermined duration of the video clip; and in response to user input: selecting one of the shots, and synchronously playing the selected shot and the video clip.

Description

Field of the Invention

[0001] This disclosure generally relates to making and using video.

[0002] Overview

[0003] In general, one disclosed aspect features a non-transitory machine-readable storage medium encoded with instructions executable by a hardware processor of a computing component, the machine-readable storage medium including instructions that cause the hardware processor to perform a method for an electronic device, the method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while repeatedly playing the video clip; automatically generating multiple takes of the user's video, each of which has a predetermined duration of the video clip; and in response to user input: selecting one of the takes, and synchronously playing the selected take and the video clip.

[0004] Embodiments of the medium may include one or more of the following features. In some embodiments, the method includes playing the captured video of the user while capturing the video of the user. In some embodiments, the method includes obtaining a video clip from a collaboration library hosted on a remote collaboration server. In some embodiments, the method includes publishing the collaboration to the collaboration library, including: uploading the selected lens to the collaboration library, and associating the selected lens with the video clip. In some embodiments, the method includes publishing the collaboration to the user's social media, including: adding one or more links to the user's social media, wherein one or more links reference the video clip and the selected lens in the collaboration library. In some embodiments, the method includes responding to a second input from the user: selecting a second music video clip, wherein the second music video clip has a predetermined duration of the music video clip, wherein the music video clip and the second music video clip have the same beats per minute, and wherein the music video clip and the second music video clip are associated with the same music clip, and repeatedly and synchronously playing the music video clip and the second music video clip. In some embodiments, the method includes, in response to a second input from a user: replacing a music video clip with a second music video clip, wherein the music video clip is associated with a first music clip, wherein the second music video clip is associated with a second music clip, and wherein the first music clip is different from the second music clip, and repeatedly and continuously playing the second music video clip. In some embodiments, repeatedly playing a video clip having a predetermined duration includes: starting playback of an image of the video clip later than playback of the sound of the video clip by an amount substantially equal to an input latency of headphones worn by a user. In some embodiments, capturing a video of a user of an electronic device includes: starting capture of an image of the user later than starting capture of the sound of the user by an amount substantially equal to an output latency of headphones worn by the user. In some embodiments, the method includes, in response to detecting a tap on a video clip, displaying metadata for the clip.

[0005] In general, one disclosed aspect features an electronic device comprising: a hardware processor; and a non-transitory machine-readable storage medium encoded with instructions executable by the hardware processor to perform a method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while the video clip is repeatedly played; automatically generating multiple shots of the user's video, each shot having a predetermined duration of the video clip; and in response to user input: selecting one of the shots, and synchronously playing the selected shot and the video clip.

[0006] Embodiments of the electronic device may include one or more of the following features. In some embodiments, the method includes playing a captured video of the user while capturing the user's video, obtaining a video clip from a collaborative work library hosted on a remote collaborative server. In some embodiments, the method includes publishing the collaborative work to the collaborative work library, including: uploading the selected lens to the collaborative work library, and associating the selected lens with the video clip. In some embodiments, the method includes publishing the collaborative work to the user's social media, including: adding one or more links to the user's social media, wherein one or more links reference the video clip and the selected lens in the collaborative work library. In some embodiments, the method includes responding to a second input from the user: selecting a second music video clip, wherein the second music video clip has a predetermined duration of the music video clip, wherein the music video clip and the second music video clip have the same beats per minute, and wherein the music video clip and the second music video clip are associated with the same piece of music, and repeatedly and synchronously playing the music video clip and the second music video clip. In some embodiments, the method includes, in response to a second input from a user: replacing the music video clip with a second music video clip, wherein the music video clip is associated with the first music clip, wherein the second music video clip is associated with the second music clip, and wherein the first music clip is different from the second music clip, and repeatedly and continuously playing the second music video clip. In some embodiments, repeatedly playing a video clip having a predetermined duration includes: starting playback of an image of the video clip later than playback of the sound of the video clip by an amount substantially equal to the input latency of headphones worn by the user. In some embodiments, capturing video of a user of an electronic device includes: starting capture of an image of the user later than starting capture of the sound of the user by an amount substantially equal to the output latency of headphones worn by the user. In some embodiments, the method includes, in response to detecting a tap on a video clip, displaying metadata for the clip.

[0007] In general, one disclosed aspect features a computer-implemented method for an electronic device, the method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while the video clip is repeatedly played; automatically generating multiple shots of the user's video, each shot having a predetermined duration of the video clip; and in response to user input: selecting one of the shots, and synchronously playing the selected shot and the video clip.

[0008] Some embodiments of the computer-implemented method include playing a captured video of the user as the user's video is captured. Some embodiments include obtaining a video clip from a collaborative work library hosted on a remote collaborative server. Some embodiments include publishing the collaborative work to the collaborative work library, including: uploading the selected shot to the collaborative work library, and associating the selected shot with the video clip. Some embodiments include publishing the collaborative work to the user's social media, including: adding one or more links to the user's social media, wherein one or more links reference the video clip and the selected shot in the collaborative work library. Some embodiments include, in response to a second input from the user: selecting a second music video clip, wherein the second music video clip has a predetermined duration of the music video clip, wherein the music video clip and the second music video clip have the same beats per minute, and wherein the music video clip and the second music video clip are associated with the same music clip, and repeatedly and synchronously playing the first music video clip and the second music video clip. Some embodiments include, in response to a second input from the user: replacing the music video clip with a second music video clip, wherein the second music video clip is associated with a second music clip, and wherein the first music clip is different from the second music clip, and repeatedly and continuously playing the second music video clip. In some embodiments, repeatedly playing a video clip having a predetermined duration includes starting playback of an image of the video clip later than playback of the sound of the video clip by an amount substantially equal to the input latency of headphones worn by the user. In some embodiments, capturing video of a user of an electronic device includes starting capture of an image of the user later than starting capture of the sound of the user by an amount substantially equal to the output latency of headphones worn by the user. Some embodiments include displaying metadata for a video clip in response to detecting a tap on the clip. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] According to one or more different embodiments, the present disclosure is described in detail with reference to the accompanying drawings. The drawings are provided for purposes of illustration only and merely depict typical or example embodiments.

[0010] Figure 1 Depicted is a block diagram of an example system for producing and using a music video collaborative work, in accordance with some embodiments of the disclosed technology.

[0011] Figure 2 Depicted is a process for using a music video collaboration tool in accordance with some embodiments of the disclosed technology.

[0012] Figure 3 A process for a feed mode of a music video collaboration tool is depicted in accordance with some embodiments of the disclosed technology.

[0013] Figure 4are example screenshots produced by a collaboration tool in feed mode according to some embodiments of the disclosed technology.

[0014] Figure 5 is an example screenshot generated by a collaboration tool in a feed mode in response to a vertical upward swipe, according to some embodiments of the disclosed technology.

[0015] Figure 6 A process for a remixing mode of a music video collaboration tool is depicted in accordance with some embodiments of the disclosed technology.

[0016] Figure 7 are example screenshots produced by the tool in remix mode according to some embodiments of the disclosed technology.

[0017] Figure 8 Depicted is a process for a recording mode of a music video collaboration tool according to some embodiments of the disclosed technology.

[0018] Fig. 9 are example screenshots generated by a collaboration tool when entering a recording mode according to some embodiments of the disclosed technology.

[0019] Fig.10 is an example screenshot generated by the collaboration tool after a user taps on one of the music video clips in accordance with some embodiments of the disclosed technology.

[0020] Fig.11 is an example screenshot generated by a collaboration tool showing how a user can adjust the volume of a clip, according to some embodiments of the disclosed technology.

[0021] Fig.12 is an example screenshot generated by a collaboration tool showing a “record” button in accordance with some embodiments of the disclosed technology.

[0022] Fig.13 is an example screenshot generated by a collaboration tool showing a countdown, according to some embodiments of the disclosed technology.

[0023] Fig.14 are example screenshots produced by the collaboration tool during a first shot, according to some embodiments of the disclosed technology.

[0024] Fig.15 are example screenshots produced by the collaboration tool during the second shot according to some embodiments of the disclosed technology.

[0025] Fig.16is an example screenshot produced when a collaboration tool enters a remix mode with a new collaborative work being displayed, in accordance with some embodiments of the disclosed technology.

[0026] Fig.17 A block diagram depicts an example computer system in which various embodiments described herein may be implemented.

[0027] The drawings are not exhaustive and do not limit the disclosure to the precise forms disclosed. Detailed Description

[0028] Watching music videos has long been a source of entertainment for music lovers. The availability of low-cost webcams, microphones, mobile phones with video recording capabilities, and broadband connections now allow video enthusiasts to create and share their own videos. The technology also allows people to combine multiple videos, such as combining videos of various musicians performing the same song. For example, a user can combine four such videos into a single video with four panes, each containing one of the videos. In such a video, users can collaborate on a vocal ensemble of a song or piece together instrumental components of a song.

[0029] Although this content format shows promise, the tools currently used to create such videos are difficult to use. First, users must create multiple videos, or coordinate the recording of multiple videos with collaborators. Each video must be well synchronized with the previously recorded video to ensure that all videos maintain the same time. Then, the user must use desktop video editing tools to splice those videos together, adjust the volume and audio of the clips, align them so that timing on all videos makes sense, and format the layout of the composition video to be visually eye-catching. Finally, the user must export the resulting work into a format suitable for sharing, share the video on the user's preferred network, and attract attention to it. These difficulties inherently limit the number of creators of such content because the process requires the use of and knowledge of complex video editing software. In addition, the time investment can be considerable, with some well-known creators reporting hundreds of hours of video editing time.

[0030] Various embodiments of the disclosed technology address these difficulties, providing simple and fun tools for creating collaborative videos in just a few minutes. The disclosed collaborative tools can be used quickly and without any expertise in any computer, smart phone, or similar electronic device. For clarity and brevity of description, embodiments for making and using music videos are described. However, it should be understood that the disclosed technology is applicable to any type of video, including, for example, comedy, visual arrangement, beauty, dance, and any other type of video that can benefit from the synchronization of multiple videos from different contributors.

[0031] In the disclosed embodiment, a library hosted by a remote server stores a collection of music video clips, wherein all music video clips in a collection have the same duration and are associated with a specific piece of music. As used herein, the term "video" is used to represent a combination of images and sounds, such as a combination of images and sounds of a musician's performance. A user can select one or more music video clips using a tool that can be implemented on an electronic device (such as a smart phone). In response, the collaboration tool downloads the selected music video clip, and loops and displays the downloaded music video clip according to the shortest duration of all clips. In the case of multiple downloaded music video clips, the collaboration tool loops and displays the clips together so that they are synchronized. For example, for a specific song, a user can use the tool to download and display a clip of a drummer playing the chorus of the song and another clip of another singer singing the chorus. In this example, because the two clips are displayed synchronously, the drummer and the singer appear to be playing together on the collaboration tool user interface.

[0032] The application can operate in a hybrid mode, where the user can use the user interface to swap out clips for other clips. Continuing with the example above, the user can replace the drummer with a bassist who also plays the chorus of the song. When the user is satisfied with the clips that are looping, the user can then publish the combination of clips as a collaborative work. For example, the user can cause the application to upload the collaborative work to a collaborative work library. Other users of the collaborative tool can find and enjoy the collaborative work in the collaborative work library. The user can also promote the collaborative work in other ways, such as by exporting or linking to the collaborative work and sharing it to the user's social network. The collaborative tool has many other features described in detail below.

[0033] In some embodiments, the user can export the collaborative work in a format suitable for sharing the collaborative work to other platforms. For example, the user can export the collaborative work in a rendered format in which the clips are connected together.

[0034] The application can operate in a recording mode, in which the user can record a music video clip to go with the looping clips. As these clips continuously loop, the application can record the user singing and / or playing an instrument, for example using the front or rear camera of a smartphone, and can display the recording and the looping clip. The user can record as many repetitions of the looping clip as desired.

[0035] When the user stops recording, the collaboration tool can automatically split the recording into shots, each of which has the same duration as the looped clips and is synchronized with them. The user can then create a collaborative work by selecting one of the shots, and the tool can associate one of the shots with the downloaded clip. The user can then publish the collaborative work. For example, the user can have the application upload the selected shot to the collaborative work library, where it is associated with the downloaded clips, which of course are still stored in the collaborative work library. Other users of the collaboration tool can find, play back and enjoy the collaborative works in the collaborative work library, and can download selected shots for use in their own collaborative works. Users can also promote collaborative works, for example as described above. The collaboration tool has many other features described in detail below.

[0036] Figure 1 A block diagram depicting an example system 100 for making and using music video collaborative works in accordance with some embodiments of the disclosed technology. While some embodiments may use all of the depicted elements of system 100, it should be understood that other embodiments may use less than all of the depicted elements.

[0037] refer to Figure 1 , the system 100 may include any number of user devices 102. The user devices 102 may be implemented as any type of device capable of performing the functions described herein for the user devices 102. For example, the user devices 102 may be implemented as smart phones, tablet computers, laptop computers, automotive head units, dedicated media players, etc.

[0038] The user device 102 may include a processing circuit 104. The processing circuit 104 may be implemented as any circuit capable of performing the functions described herein. For example, the processing circuit 104 may be implemented as a microprocessor, a microcontroller, etc.

[0039] The user device 102 may include a user input circuit 106. The user input circuit 106 may be implemented as any type of circuit capable of receiving user input and providing a corresponding control signal to the processing circuit 104. For example, the user input circuit 106 may be implemented as a touch screen, a keyboard, a mouse, a trackball, a joystick, etc., or any combination thereof.

[0040] The user device 102 may include an audio circuit 108. The audio circuit 108 may be implemented as any circuit capable of presenting audio as sound. As used herein, the term "audio" is used to refer to a signal representing sound. For example, the audio circuit 108 may include a speaker, etc.

[0041] The user device 102 may include a video circuit 110. The video circuit 110 may be implemented as any circuit capable of presenting a video as an image. For example, the video circuit 110 may include a display, a touch screen, and the like.

[0042] In some embodiments, the user device 102 may include a communication circuit 112 that communicates with the audio device 132. The communication may be wired or wireless. For example, the audio device 132 may be implemented as a Bluetooth headset, a wired earbud headset, etc. Therefore, the communication circuit 112 may be implemented as a Bluetooth transceiver, a wired communication interface, etc.

[0043] The user device 102 may include a memory circuit 114. The memory circuit 114 may store a collaboration tool 116. The memory circuit 114 may be implemented as any memory. In a user device 102 such as a smart phone, the collaboration tool 116 may be implemented as an application. In a user device 102 such as a laptop computer, the collaboration tool 116 may be implemented as a browser extension that works in conjunction with a web browser. Of course, the collaboration tool 116 may be implemented in other ways in these and other devices. The memory circuit 114 may also store one or more music video clips 118.

[0044] The audio device 132 may include a communication circuit 134 that communicates with the user device 102. The audio device 132 may include an audio circuit 136. The communication circuit 134 and the audio circuit 136 of the audio device 132 may be implemented in a manner similar to that described above for the communication circuit 112 and the audio circuit 108 of the user device 102, respectively. One or all components of the audio device may be built into the user device, such as a built-in microphone and speaker.

[0045] The system 100 may include one or more collaboration servers 142. Each collaboration server 142 may include one or more collaboration libraries 146. The collaboration libraries may be managed by a collaboration library manager 144. Each collaboration library 146 may store one or more collections 148. Each collection 148 may be associated with a specific music segment (e.g., a song, a melody, a rhythm, etc., or any part thereof). Each collection 148 may store one or more music video clips 118 associated with the music segment of the collection and one or more collaboration works 152 using one or more music video clips in these music video clips 118. In a collection 148, all music video clips 118 have the same duration and tempo, and start and stop at the same position in the associated music segment. The tempo may be described in beats per minute (BPM). All music video clips 118 in a collection 148 may be associated with a specific key, and may share other features, such as a music style, etc. The similarities between the music video clips 118 in a collection 148 allow them to be appreciated together in any combination. And as mentioned above, users can post their own music video clips 118 to the collection.

[0046] The system 100 may include one or more social media servers 162. The social media server 162 may store the user's social media 164. The user's social media 164 may be stored in any manner that can support the functions described herein. For example, the user's social media 164 may be implemented as a network-connected database, etc. As used herein, the term "social media" includes any media provided by any social network used by the user. For example, social media may include information about the user and other users (referred to herein as "friends") in the user's social network and / or information provided by the user and other users in the user's social network. Social media may include social content, social signals, etc. Social content may include content shared by a user or friend, such as videos, photos, articles, comments on shared media, etc. Social content may include events shared by a user or friend, messages sent by a user or friend, etc. Social content may include messages automatically generated by a social network, such as "your friend is engaged", "your friend has a birthday", etc. Social signals may include indications of the user's or friend's interaction with social content. For example, a social signal may indicate whether a friend likes a particular post, whether a friend shares the post, how many times the post has been liked, viewed, or shared, etc. Social signals can include any information that describes a social network. For example, a social signal can include information about social media groups to which a user or friend belongs.

[0047] The system 100 may include a network 172 through which the client device 102, the collaboration server 142, and the social media server 162 may communicate. The network 172 may be implemented as any network capable of supporting the communications described herein. For example, the network 172 may be implemented using the Internet.

[0048] Figure 2 A process 200 for using a music video collaboration tool according to some embodiments of the disclosed technology is depicted. Although the elements of the process disclosed herein are presented in a particular arrangement, it should be understood that one or more elements may be omitted, performed in a different order, performed simultaneously, etc. The process 200 may be performed by Figure 1 The example system 100 may be implemented by one or more elements of the example system 100.

[0049] refer to Figure 2 , process 200 may include launching the collaboration tool at 202. For example, a user of a smartphone may install the collaboration tool as an application and then launch the application by tapping an icon for the application. As another example, a user of a laptop may install the collaboration tool as a browser extension and then launch the browser extension by clicking on an icon for the extension. As yet another example, the tool may be implemented within a website that a user may access with a browser.

[0050] If the user is not a new user at 204, the tool may allow the user to log in at 208. However, if the user is a new user of the collaboration tool at 204, the tool may perform an onboarding process for the user at 206. For example, the collaboration tool may allow the user to create an account, login credentials, etc. After the onboarding process, the tool may allow the user to log in at 208. After logging in, the tool may allow the new user to create a profile, agree to the terms and conditions of the tool, etc. As part of creating a profile, the user may upload a profile photo, establish a username, enter a short bio, etc. In some embodiments, the user may log in using a social media account.

[0051] After logging in, the tool enters a "feed" mode at 210. In the feed mode, the tool displays various collaborative works. Each collaborative work includes one or more music video clips of a specific piece of music. In some embodiments, the collaborative tool can automatically load collaborative works. For example, the collaborative work can be the last collaborative work viewed by the user, a popular collaborative work, a collaborative work selected by an algorithm based on the user's interests, etc. The tool can allow the user to select a collaborative work. In response to the user selecting a collaborative work, the tool enters a "remix" mode at 212. In the remix mode, the tool allows the user to replace one or more music video clips with other music video clips associated with the same specific piece of music. At any time in the remix mode, the user can choose to contribute video to the collaborative work. In response to such a selection, the tool enters a "record" mode at 214. In the recording mode, the tool allows the user to replace one of these video clips by recording one or more "shots" while playing together with other looping music video clips. The user can stop recording at any time. In response to the user stopping recording, the tool returns to the remix mode at 212. In remix mode, the tool allows the user to select recorded footage for inclusion in a collaborative work. The tool also allows the user to swap out other music video clips in the collaborative work for other music video clips associated with the same particular piece of music. When the user is satisfied with the collaborative work, the user may choose to publish the collaborative work. In response to such a selection, the tool may publish the collaborative work to one or more collaborative work libraries 146. At this point, the collaborative work is available for other users to enjoy and modify to create their own collaborative works. The tool also allows the user to promote the collaborative work in the user's social media 164, for example, by creating a link to the collaborative work in social media 164. Each of these tool modes is now described in detail.

[0052] Figure 3 Depicted is a process 300 for a feed mode of a music video collaboration tool according to some embodiments of the disclosed technology. The process 300 may be performed by Figure 1 One or more elements of the example system 100 are implemented. Figure 3, process 300 may include playing the collaborative work at 302. Playing the collaborative work may include looping (i.e., repeatedly and continuously playing) one or more music video clips associated with a particular piece of music. When the collaborative work includes multiple music video clips, all music video clips may be associated with the same piece of music, may have the same duration and beat, and may be played together (i.e., synchronously). For example, all music video clips in the collaborative work may last 15 seconds and may all have a beat of 120 beats per minute. And all music video clips in the collaborative work may start and stop at the same position in the music piece. In the case of some or all of these features, the music video clips of the collaborative work are combined to form an enjoyable musical ensemble that is repeated as long as the user likes. In some embodiments, the tool may create a song library based on basic characteristics such as beats and scales to allow users to combine different songs to make creative mashups that sound good together. The tool may allow users to search for clips in the application based on these basic characteristics.

[0053] Figure 4 is an example screenshot 400 that may be generated by a collaboration tool in feed mode according to some embodiments of the disclosed technology. Figure 4 In the example of , a collaborative work 402 is shown that includes three music video clips that loop together: at 404, a person playing a synthesizer; at 406, a person singing; and at 408, a person playing a keyboard. In the described embodiment, the collaborative work has three video clips that all have the same aspect ratio. In other embodiments, the collaborative work can have a different number of video clips, video clips of different aspect ratios, or both. Several icons are shown at 410 in screenshot 400 that allow a user to share or tag the collaborative work 402, such as to share the collaborative work to Instagram. TM Story, Facebook TM Pages, etc.

[0054] Back to Figure 3 , the collaboration tool detects user input and responds to the user input. For example, in response to detecting a vertical swipe on the touch screen of the smart phone at 304, the collaboration tool selects another collaborative work at 306. In some embodiments, each time a new collaborative work is selected, the tool begins playing the music video clips in the selected collaborative work together at time 0. The tool can also display gestures that the user can make to control the tool. Figure 5is an example screenshot 500 that may be generated by the collaboration tool in a feed mode in response to a swipe up, according to some embodiments of the disclosed technology. In response to the swipe up, the collaboration tool scrolls the display up to replace the current collaboration work 402 with a new collaboration work 502. The new collaboration work 502 may be associated with the same piece of music or with a different piece of music. In some embodiments, during the scrolling, the collaboration tool fades the sound of the old collaboration work out and the sound of the new collaboration work in, creating a smooth blending effect.

[0055] Back to Figure 3 In response to detecting a tap on one of the music video clips in the collaborative work at 308, the collaboration tool displays metadata for the clip at 310. The metadata may include, for example, the name of the music piece associated with the collaborative work, the username of the contributor to the clip, etc. In response to detecting a horizontal scroll over one of the music video clips in the collaborative work at 312, the collaboration tool enters a remix mode at 314.

[0056] Figure 6 Depicted is a process 600 for the remix mode 212 of the music video collaboration tool according to some embodiments of the disclosed technology. The process 600 may be performed by Figure 1 One or more elements of the example system 100 are implemented. Figure 6 The process 600 may include replacing the music video clip associated with the same music segment at 602 with another music video clip associated with the same music segment. Figure 3 312 in the horizontal slide of the music video clip, thereby creating a new collaborative work for the same music clip. In some embodiments, the collaboration tool makes the sound of the old clip fade out and the sound of the new clip fade in, creating a smooth blending effect. The tool then, for example, uses the above reference Figure 2 The user can then scroll horizontally through any of the music video clips in the looping collaborative work.

[0057] Figure 7 is an example screenshot 700 that may be produced by the tool in remix mode according to some embodiments of the disclosed technology. Figure 7 In the example of , a collaborative work 702 is shown, which includes three music video clips that loop together: at 704, a person is singing; at 706, a person is playing guitar; and at 708, a person is playing drums. Also shown in screenshot 700 is a "+" button 710 and a "publish" button 712.

[0058] This tool monitors user input. Return to Figure 6In response to detecting a horizontal swipe at 606, the collaboration tool replaces the swiped music video clip with another music video clip associated with the same music clip at 602, and then begins looping a new collaborative work at 604. In some embodiments, the collaboration tool fades the sound of the old clip out and the sound of the new clip in, creating a smooth blending effect. The tool can start the collaborative work at time 0, or can continue looping from the swipe time. This process can be repeated as many times as the user likes.

[0059] The user may place the collaboration tool into recording mode at any time. In response to detecting a tap on the "+" button 710 at 608, the collaboration tool may enter recording mode at 610. In some embodiments, the tool may enter recording mode when the user swipes left on a music video clip, and select a new music video clip when the user swipes right.

[0060] The user may return to the remix mode at any time.In response to detecting the tapping of the "Publish" button 712 at 612, the collaboration tool publishes the collaborative work at 614, such as described above.

[0061] Figure 8 Depicts a process 800 for recording mode 214 of a music video collaboration tool according to some embodiments of the disclosed technology. The process 800 may be performed by Figure 1 One or more elements of the example system 100 are implemented. Figure 8 , process 800 may include detecting a tap on one of the music video clips in the collaborative work at 802. In response to detecting such a tap, the collaboration tool displays a user's video in place of the tapped music video clip at 804. The user's video may be captured, for example, by a front-facing camera of a smartphone executing the collaboration tool.

[0062] Fig. 9 is an example screenshot 900 that may be generated by a collaboration tool when entering recording mode 214 according to some embodiments of the disclosed technology. Fig. 9 , the collaboration tool may number each music video clip, and may prompt the user to select which clip to be replaced by the user's recording. In these screenshot drawings, cross-hatching is used to indicate darkened portions of the screen.

[0063] Fig.10 is an example screenshot 1000 that may be generated by the collaboration tool after a user taps on one of the music video clips, according to some embodiments of the disclosed technology. Fig.10In the example of , the user tapped the clip numbered 2, and the collaboration tool has replaced the clip with the user's live video. The music video clips can continue to loop during this process. To prevent feedback, the tool can prompt the user to put on headphones at 1002. The user can continue by tapping the "next" button 1004.

[0064] In some embodiments, the tool allows the user to adjust the playback volume of each music video clip by swiping vertically across each video clip. In remix mode, the tool allows the user to adjust the volume of all clips in the collaborative work, regardless of the volume used when recording. Fig.11 is an example screenshot 1100 that may be generated by the collaboration tool in the next step according to some embodiments of the disclosed technology. Fig.11 , the collaboration tool displays prompts on each music video clip, which show the user how to adjust their volume at 1102 and 1104. The user can continue by tapping the "next" button 1106.

[0065] In some embodiments, the collaboration tool automatically compensates for the delay introduced by the headset when recording. The delay can be obtained from the headset manufacturing specifications or other sources, can be determined empirically, etc. In particular, during recording, the playback of the image can start later than the playback of the sound by an amount substantially equal to the input delay of the headset, so that the playback of the image and the playback of the sound appear to be synchronized to the user. Similarly, the recorded sound can be moved forward in time to be synchronized with the recorded image and with the played back sound and the played back image. In particular, the capture of the user's image can start later than the capture of the user's sound by an amount substantially equal to the output delay of the headset. In this way, the delay introduced by the headset can be accommodated.

[0066] Fig.12 is an example screenshot 1200 that may be generated by the collaboration tool in the next step according to some embodiments of the disclosed technology. Fig.12 , the collaboration tool displays a "record" button 1202 and monitors the user input. The collaboration tool also displays a button 1204 that allows the user to switch between the front and rear cameras of the smartphone.

[0067] Back to Figure 8 In response to detecting a tap on the "record" button 1202 at 806, the collaboration tool displays a countdown at 808. The countdown may be timed to the beats per minute (BPM) of the music clip and may indicate the number of beats remaining before recording begins. Fig.13 is an example screenshot 1300 that may be generated by the collaboration tool at this stage according to some embodiments of the disclosed technology. Fig.13, the countdown can be displayed as a numerical value superimposed on the user's video.

[0068] Return to Figure 8 , when the countdown elapses, at 810, the collaboration tool records the user's video while looping the music video clip. In some embodiments, the tool plays the sound of the music video clip. In some embodiments, the tool plays a music clip. In some embodiments, the tool plays a metronome. In some embodiments, the video format is horizontal, but the user can record in a vertical video format. In such an embodiment, the tool can display where the vertical video will be cropped during the conversion to the horizontal video format.

[0069] In some embodiments, the collaboration tool automatically segments the user's video recording into shots. In particular, the collaboration tool creates a shot for each loop of the music video clip. Fig.14 is an example screenshot 1400 that may be generated by a collaboration tool during a first shot (which is labeled “Shot 1 ” in screenshot 1400 ) in accordance with some embodiments of the disclosed technology. Fig.15 is an example screenshot 1500 produced by the collaboration tool during the second shot (which is labeled "Shot 2" in screenshot 1500) according to some embodiments of the disclosed technology. In some embodiments, the tool can indicate the beat of the music by pulsing the record button 1202.

[0070] In some embodiments, the tool may allow the user to record a video that is longer than the duration of the music video clip. In such embodiments, the tool may prompt the user to trim the video until it is equal to the duration, or may automatically trim the video until it is equal to the duration.

[0071] The user can stop recording at any time by tapping the record button 1202. Return to Figure 8 In response to detecting the tapping of the “record” button 1202 at 812 , the collaboration tool enters a remix mode at 814 with the new collaborative work displayed. Fig.16 is an example screenshot 1600 that may be generated by the collaboration tool at this stage according to some embodiments of the disclosed technology. Fig.16 , the tool may allow the user to select one of the shots by swiping horizontally across the shots, by bookmarking the shots (e.g., by tapping the bookmark icon 1602), and by deleting unwanted shots (e.g., by tapping the "X" button 1604). The tool may allow the user to save the collaborative work, e.g., by tapping a "Save" button 1606. The tool may allow the user to publish the collaborative work, e.g., by tapping a "Publish" button 1608, e.g., as described above.

[0072] Fig.17 A block diagram of an example computer system 1700 is depicted in which various embodiments described herein may be implemented. The computer system 1700 may be implemented in the form of any device. For example, the computer system 1700 may be implemented in the form of a smartphone, a tablet computer, a laptop computer, a car head unit, etc. In some embodiments, portions of the computer system 1700 may be implemented in the cloud.

[0073] Computer system 1700 includes a bus 1702 or other communication mechanism for communicating information and one or more hardware processors 1704 coupled with bus 1702 for processing information. Hardware processor 1704 may be, for example, one or more general-purpose microprocessors.

[0074] The computer system 1700 also includes a main memory 1706, such as a random access memory (RAM), a cache, and / or other dynamic storage device, coupled to the bus 1702 for storing information and instructions executed by the processor 1704. The main memory 1706 may also be used to store temporary variables or other intermediate information during the execution of instructions executed by the processor 1704. Such instructions, when stored in a storage medium accessible to the processor 1704, turn the computer system 1700 into a special-purpose machine customized to perform the operations specified in the instructions. In particular, the instructions may implement the disclosed embodiments.

[0075] The computer system 1700 also includes a read only memory (ROM) 1708 or other static storage device coupled to the bus 1702 for storing static information and instructions for the processor 1704. A storage device 1710, such as a magnetic disk, optical disk, or USB thumb drive (flash drive), etc., is provided and coupled to the bus 1702 for storing information and instructions.

[0076] Computer system 1700 may be coupled to a display 1712, such as a liquid crystal display (LCD) (or touch screen), via bus 1702 for displaying information to a computer user. Input devices 1714, including alphanumeric and other keys, are coupled to bus 1702 for communicating information and command selections to processor 1704. Another type of user input device is a cursor control device 1716, such as a mouse, trackball, or cursor direction keys, for communicating directional information and command selections to processor 1704 and for controlling cursor movement on display 1712. In some embodiments, directional information and command selections similar to cursor control may be achieved by receiving touches on a touch screen without a cursor.

[0077] The computing system 1700 may include a user interface module that implements a GUI that may be stored in a mass storage device as executable software code executed by the computing device. As examples, this and other modules may include components (such as software components, object-oriented software components, class components, and task components), processes, functions, properties, procedures, subroutines, program code segments, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

[0078] In general, the words "component", "engine", "system", "database", "data repository", etc. as used herein may refer to logic embodied in hardware or firmware or to a collection of software instructions written in a programming language (e.g., Java, C, or C++) that may have entry points and exit points. Software components may be compiled and linked into executable programs installed in a dynamic link library, or may be written in an interpreted programming language (e.g., BASIC, Perl, or Python). It will be appreciated that software components may be callable from other components or from themselves, and / or may be called in response to detected events or interruptions. Software components configured to be executed on a computing device may be provided on a computer-readable medium (such as an optical disc, a digital video disc, a flash drive, a disk, or any other tangible medium) or as a digital download (and may be initially stored in a compressed or installable format that requires installation, decompression, or decryption prior to execution). Such software code may be stored in part or in whole on a memory device that executes a computing device for execution by the computing device. Software instructions may be embedded in firmware (such as an EPROM). It will further be appreciated that hardware components may be composed of connected logic units (such as gates and flip-flops), and / or may be composed of programmable units (such as programmable gate arrays or processors).

[0079] The computer system 1700 may implement the techniques described herein using custom hardwired logic, one or more ASICs or FPGAs, firmware, and / or program logic that is combined with the computer system to enable the computer system 1700 or program the computer system 1700 as a special purpose machine. According to one embodiment, the techniques herein are performed by the computer system 1700 in response to the processor 1704 executing one or more sequences of one or more instructions contained in the main memory 1706. Such instructions may be read into the main memory 1706 from another storage medium, such as the storage device 1710. Execution of the sequences of instructions contained in the main memory 1706 causes the processor 1704 to perform the process steps described herein. In alternative embodiments, hardwired circuits may be used instead of software instructions or in combination with software instructions.

[0080] As used herein, the term "non-transitory media" and similar terms refer to any medium that stores data and / or instructions that cause a machine to operate in a particular manner. Such non-transitory media may include non-volatile media and / or volatile media. Non-volatile media include, for example, optical or magnetic disks, such as storage device 1710. Volatile media include dynamic memory, such as main memory 1706. Common forms of non-transitory media include, for example, floppy disks, flexible disks, hard disks, solid-state drives, magnetic tapes or any other magnetic data storage media, CD-ROMs, any other optical data storage media, any physical media with a pattern of holes, RAM, PROMs and EPROMs, FLASH-EPROMs, NVRAMs, any other memory chips or cassettes and network versions thereof.

[0081] Non-transitory media are distinct from transmission media, but can be used in conjunction with transmission media. Transmission media participate in the transfer of information between non-transitory media. For example, transmission media include coaxial cables, copper wires, and optical fibers, including the wires that comprise bus 1702. Transmission media can also take the form of acoustic or light waves, such as those generated during radio wave and infrared data communications.

[0082] Computer system 1700 also includes a communication interface 1718 coupled to bus 1702. Network interface 1718 provides a two-way data communication mechanism coupled to one or more network links connected to one or more local networks. For example, communication interface 1718 can be an integrated services digital network (ISDN) card, cable modem, satellite modem or modem that provides data communication connections to corresponding types of telephone lines. As another example, network interface 1718 can be a local area network (LAN) card that provides data communication connections to compatible LANs (or WAN components that communicate with WAN). Wireless links can also be implemented. In any such implementation, network interface 1718 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.

[0083] A network link generally provides data communication to other data devices through one or more networks. For example, a network link may provide a connection to a host computer or data equipment operated by an Internet Service Provider (ISP) through a local network. The ISP, in turn, provides data communication through the global packet data communication network now commonly referred to as the "Internet." Both local area networks and the Internet use electrical, electromagnetic, or optical signals that carry digital data streams. The signals through the various networks and the signals on the network link and through the communication interface 1718 are example forms of transmission media that carry digital data to and from the computer system 1700.

[0084] Computer system 1700 can send messages and receive data, including program code, through the network, network links and communications interface 1718. In the Internet example, a server can transmit the requested code for an application program through the Internet, an ISP, a local network and communications interface 1718.

[0085] The received code may be executed by processor 1704 as it is received and / or stored in storage device 1710 or other non-volatile storage for later execution.

[0086] Each process, method and algorithm described in the previous sections can be embodied in a code component executed by one or more computer systems or computer processors including computer hardware, and fully or partially automated by the code component. One or more computer systems or computer processors can also operate to support the performance of related operations in a "cloud computing" environment or as a "software as a service (SaaS)". The process and algorithm can be implemented in part or in whole in a dedicated circuit. The various features and processes described above can be used independently of each other, or can be combined in various ways. Different combinations and sub-combinations are intended to fall within the scope of the present disclosure, and certain methods or process blocks can be omitted in some implementations. The methods and processes described herein are also not limited to any particular order, and the blocks or states associated therewith can be executed in other suitable orders, or can be executed in parallel or in some other way. Blocks or states can be added to or removed from the disclosed example embodiments. The performance of certain operations or processes can be distributed among computer systems or computer processors, not just residing in a single machine, but deployed in multiple machines.

[0087] As used herein, any form of hardware, software, or combination thereof may be used to implement a circuit. For example, one or more processors, controllers, ASICs, PLAs, PALs, CPLDs, FPGAs, logic components, software routines, or other mechanisms may be implemented to form a circuit. In some implementations, the various circuits described herein may be implemented as discrete circuits, or the functions and features described may be shared in part or in whole in one or more circuits. Even if the various features or elements of a function may be described or claimed as separate circuits individually, these features and functions may also be shared in one or more common circuits, and such descriptions should not require or imply that separate circuits need to implement such features or functions. In the case where a circuit is implemented in whole or in part using software, such software may be implemented to operate with a computing or processing system (such as computer system 1700) that is capable of performing the functions described therein.

[0088] As used herein, the term "or" may be interpreted in an inclusive or exclusive sense. Moreover, the description of a resource, operation, or structure in the singular should not be understood to exclude the plural. Unless otherwise expressly stated or otherwise understood in the context as used, conditional language (such as, inter alia, "can," "might," "may," or "perhaps," etc.) is generally intended to convey that certain embodiments include certain features, elements, and / or steps, while other embodiments do not include certain features, elements, and / or steps.

[0089] Unless expressly stated otherwise, terms and phrases used in this document and variations thereof should be interpreted as open-ended, as opposed to restrictive. Adjectives (such as "conventional," "traditional," "normal," "standard," "known," and terms of similar meaning) should not be interpreted as limiting the items described to a given time period or to items available as of a given time, but instead should be understood to include conventional, traditional, normal, or standard technology that may be available or known, now or at any time in the future. The presence of expanded words and phrases (such as "one or more," "at least," "but not limited to," or other similar phrases) in some instances should not be understood to mean that narrower circumstances are expected or required in instances where such expanded phrases may be absent.

Claims

1. A non-transitory machine-readable storage medium encoded with instructions executable by a hardware processor of a computing component, the machine-readable storage medium comprising instructions for causing the hardware processor to perform a method for an electronic device, the method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while repeatedly playing the video clip; automatically generating a plurality of shots of a user's video, wherein each shot has the predetermined duration of the video clip; as well as In response to user input: One of the lenses is selected, and The selected shot and the video clip are played synchronously.

2. The medium of claim 1, wherein the method further comprises: Plays the captured video of the user as it is being captured.

3. The medium of claim 1, the method further comprising: The video clip is obtained from a collaborative work library hosted on a remote collaborative server.

4. The medium of claim 3, the method further comprising: Publishing the collaborative work to the collaborative work library includes: uploading the selected footage to the collaborative work library, and The selected shot is associated with the video clip.

5. The medium of claim 1, the method further comprising: Post collaborative works to users' social media, including: One or more links are added to the user's social media, wherein the one or more links reference the video clip and the selected shot in the collaborative work library.

6. The medium of claim 1, the method further comprising: In response to the user's second input: selecting a second music video clip, wherein the second music video clip has the predetermined duration of the video clip, wherein the video clip and the second music video clip have the same beats per minute, and wherein the video clip and the second music video clip are associated with the same piece of music, and The video clip and the second music video clip are played repeatedly and synchronously.

7. The medium of claim 1, the method further comprising: In response to the user's second input: replacing the video clip with a second music video clip, wherein the video clip is associated with a first piece of music, wherein the second music video clip is associated with a second piece of music, and wherein the first piece of music is different from the second piece of music, and The second music video clip is played repeatedly and continuously.

8. The medium of claim 1, wherein repeatedly playing a video clip having a predetermined duration comprises: Playback of the images of the video clip begins later than playback of the sounds of the video clip by an amount substantially equal to the input delay of headphones worn by the user.

9. The medium of claim 1 , wherein capturing video of a user of the electronic device comprises: Capture of the user's image is initiated later than capture of the user's voice is initiated by an amount substantially equal to the output delay of headphones worn by the user.

10. The medium of claim 1, the method further comprising: In response to detecting a tap on the video clip, metadata for the clip is displayed.

11. An electronic device, comprising: Hardware processor; as well as A non-transitory machine-readable storage medium encoded with instructions executable by the hardware processor to perform a method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while repeatedly playing the video clip; automatically generating a plurality of shots of a user's video, wherein each shot has the predetermined duration of the video clip; and In response to user input: One of the lenses is selected, and The selected shot and the video clip are played synchronously.

12. The electronic device according to claim 11, the method further comprising: Plays the captured video of the user as it is being captured.

13. The electronic device according to claim 11, the method further comprising: The video clip is obtained from a collaborative work library hosted on a remote collaborative server.

14. The electronic device according to claim 13, the method further comprising: Publishing the collaborative work to the collaborative work library includes: uploading the selected footage to the collaborative work library, and The selected shot is associated with the video clip.

15. The electronic device according to claim 11, the method further comprising: Post collaborative works to users' social media, including: One or more links are added to the user's social media, wherein the one or more links reference the video clip and the selected shot in the collaborative work library.

16. The electronic device according to claim 11, the method further comprising: In response to the user's second input: selecting a second music video clip, wherein the second music video clip has the predetermined duration of the video clip, wherein the video clip and the second music video clip have the same beats per minute, and wherein the video clip and the second music video clip are associated with the same piece of music, and The video clip and the second music video clip are played repeatedly and synchronously.

17. The electronic device according to claim 11, the method further comprising: In response to the user's second input: replacing the video clip with a second music video clip, wherein the video clip is associated with a first piece of music, wherein the second music video clip is associated with a second piece of music, and wherein the first piece of music is different from the second piece of music, and The second music video clip is played repeatedly and continuously.

18. The electronic device of claim 11, wherein repeatedly playing a video clip having a predetermined duration comprises: Playback of the images of the video clip begins later than playback of the sounds of the video clip by an amount substantially equal to the input delay of headphones worn by the user.

19. The electronic device of claim 11, wherein capturing video of a user of the electronic device comprises: Capture of the user's image is initiated later than capture of the user's voice is initiated by an amount substantially equal to the output delay of headphones worn by the user.

20. The electronic device according to claim 11, the method further comprising: In response to detecting a tap on the video clip, metadata for the clip is displayed.

21. A computer-implemented method for an electronic device, the method comprising: repeatedly playing a video clip having a predetermined duration; capturing video of a user of the electronic device while repeatedly playing the video clip; automatically generating a plurality of shots of a user's video, wherein each shot has the predetermined duration of the video clip; as well as In response to user input: One of the lenses is selected, and The selected shot and the video clip are played synchronously.

22. The computer-implemented method of claim 21 , further comprising: Plays the captured video of the user as it is being captured.

23. The computer-implemented method of claim 21 , further comprising: The video clip is obtained from a collaborative work library hosted on a remote collaborative server.

24. The computer-implemented method of claim 23, further comprising: Publishing the collaborative work to the collaborative work library includes: uploading the selected footage to the collaborative work library, and The selected shot is associated with the video clip.

25. The computer-implemented method of claim 21 , further comprising: Post collaborative works to users' social media, including: One or more links are added to the user's social media, wherein the one or more links reference the video clip and the selected shot in the collaborative work library.

26. The computer-implemented method of claim 21, further comprising: In response to the user's second input: selecting a second music video clip, wherein the second music video clip has the predetermined duration of the video clip, wherein the video clip and the second music video clip have the same beats per minute, and wherein the video clip and the second music video clip are associated with the same piece of music, and The video clip and the second music video clip are played repeatedly and synchronously.

27. The computer-implemented method of claim 21 , further comprising: In response to the user's second input: replacing the video clip with a second music video clip, wherein the video clip is associated with a first piece of music, the second music video clip is associated with a second piece of music, and wherein the first piece of music is different from the second piece of music, and The second music video clip is played repeatedly and continuously.

28. The computer-implemented method of claim 21, wherein repeatedly playing a video clip having a predetermined duration comprises: Playback of the images of the video clip begins later than playback of the sounds of the video clip by an amount substantially equal to the input delay of headphones worn by the user.

29. The computer-implemented method of claim 21 , wherein capturing video of a user of the electronic device comprises: Capture of the user's image is initiated later than capture of the user's voice is initiated by an amount substantially equal to the output delay of headphones worn by the user.

30. The computer-implemented method of claim 21, further comprising: In response to detecting a tap on the video clip, metadata for the clip is displayed.

Images