Method, system, non-transitory computer-readable storage medium and computer program product

JP2025504697AActive Publication Date: 2025-02-14LEMON CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024545814
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-31
Filing Date
2023-01-16
Publication Date
2025-02-14
Estimated Expiration
2043-01-16

Smart Images

  • Figure 2025504697000001_ABST
    Figure 2025504697000001_ABST
Patent Text Reader

Abstract

This disclosure describes techniques for facilitating interaction with content using interactive effects. The techniques include receiving a video from a first computing device associated with a first user of a plurality of users. The video is generated with interactive effects. The interactive effects include overlaying at least one component on at least a subset of frames of the video. The interactive effects enable the video to be interacted with other users of the plurality of users. The video is presented at a second computing device associated with a second user of the plurality of users. The video includes information indicating instructions on how to interact with the video. In response to receiving an indication of interaction with the video by the second user, a display of an animation associated with the at least one component may be automatically caused at the second computing device.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority to U.S. Patent No. 17 / 589,673 (titled "Content Creation Using Interactive Effects"), filed on January 31, 2022, the disclosure of which is incorporated herein by reference in its entirety. [Background technology]

[0002] Increasingly, communication is conducted using Internet-based tools. Internet-based tools can be any software or platform. Existing social media platforms such as YouTube® and Facebook® allow users to communicate with each other by sharing information such as images and videos through static applications or web pages. As communication devices such as mobile phones become more and more sophisticated, people continue to seek new ways of entertainment, social networking and communication. [Brief description of the drawings]

[0003] The following detailed description can be better understood when read in conjunction with the accompanying drawings, in which: For purposes of illustration, there are shown in the accompanying drawings exemplary embodiments of various aspects of the disclosure; however, the invention is not limited to the specific methods and instrumentalities disclosed.

[0004] [Figure 1] FIG. 1 illustrates an exemplary system for distributing content.

[0005] [Diagram 2] FIG. 2 illustrates an exemplary user interface of a content delivery application in accordance with the present disclosure.

[0006] [Diagram 3]FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0007] [Figure 4A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0008] [Figure 4B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0009] [Figure 5A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0010] [Figure 5B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0011] [Figure 6A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0012] [Figure 6B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0013] [Figure 7A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0014] [Figure 7B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0015] [Figure 8] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0016] [Figure 9] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0017] [Figure 10] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0018] [Figure 11A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0019] [Figure 11B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0020] [Figure 12A] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0021] [Figure 12B] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0022] [Figure 13] FIG. 2 illustrates another exemplary user interface of a content delivery application in accordance with the present disclosure.

[0023] [Figure 14] FIG. 2 illustrates an exemplary content creation method executable by a user device in accordance with the present disclosure.

[0024] [Figure 15] FIG. 1 illustrates another exemplary content creation method executable by a user device in accordance with the present disclosure.

[0025] [Figure 16] FIG. 1 illustrates another exemplary content creation method executable by a user device in accordance with the present disclosure.

[0026] [Figure 17] FIG. 1 illustrates an example computing device that can be used to perform any of the methods disclosed herein. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Content delivery platforms may provide a number of augmented reality (AR) lenses, filters, or effects for use by their users. For example, the content delivery platform may provide one or more AR lenses, filters, or effects that users of the content delivery platform can use to create photos or videos. When a user creates a video or photo with one or more AR lenses, filters, or effects, the video or photo may feature one or more AR components overlaid on the photo or on at least a subset of the video frames. The AR components may include, for example, two-dimensional computer-generated graphics and / or three-dimensional computer-generated graphics.

[0028] However, such AR lenses, filters, or effects may not be utilized by users of the content distribution platform who want to view content rather than create new content. For example, the AR lenses, filters, or effects may only be used when a user creates a new video for other users to view. In many cases, users may utilize the content distribution platform only to view or consume content without opening their camera. These users do not have the opportunity to experience or interact with the AR lenses, filters, or effects unless they take multiple steps to open their camera. Thus, there is a need for improved content creation and distribution techniques.

[0029] This disclosure describes interactive effects that can be used to create content, e.g., videos. Content created with these interactive effects may be distributed to and viewed by other users. Other users may see the content and interact with the content while viewing it. By facilitating content creation with interactive effects, the techniques described in this disclosure enable more users of a content distribution platform to experience AR lenses, filters, or effects without creating content or opening their cameras. As a result, the user experience on the content distribution platform is improved.

[0030] 1 illustrates an example system 100 for delivering content. The system 100 may include a cloud network 102 and a number of client devices 104a-d. The cloud network 102 and the number of client devices 104a-d may communicate with each other via one or more networks 120.

[0031] Cloud network 102 may be located in a data center, such as a single building, or may be distributed across different geographic locations (e.g., several buildings). Cloud network 102 may provide services through one or more networks 120. Networks 120 include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or similar devices. Networks 120 may include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, etc. Networks 120 may include wireless links, such as cellular links, satellite links, Wi-Fi links, etc.

[0032] The cloud network 102 may include multiple computing nodes 118 hosting various services. In one embodiment, the nodes 118 host a video service 112. The video service 112 may include a content streaming service, such as an Internet Protocol video streaming service. The video service 112 may be configured to deliver content 116 via various transmission technologies. The video service 112 is configured to provide content 116, such as video, audio, text data, combinations thereof, etc. The content 116 may include content streams (e.g., video streams, audio streams, information streams), content files (e.g., video files, audio files, text files), and / or other data. The content 116 may be stored in a database 114. For example, the video service 112 may include a video sharing service, a video hosting platform, a content distribution platform, a collaborative gaming platform, etc.

[0033] In one embodiment, the content 116 delivered or provided by the video service 112 includes short videos. The short videos may have a duration of up to a predetermined time limit, such as one minute, five minutes, or other predetermined minutes. By way of example and not limitation, the short videos may include at least one and up to four 15-second segments joined together. Short video durations can provide viewers with entertainment in rapid succession, allowing users to watch a large amount of video within a short time frame. Such rapid succession entertainment can be popular on social media platforms. In other embodiments, the content 116 delivered or provided by the video service 112 includes long videos instead of or in addition to short videos.

[0034] Videos, e.g., short videos and / or long videos, may include pre-recorded audio overlays, such as music or sounds from a television show or movie. When a video includes a pre-recorded audio overlay, the video may feature one or more people lip-syncing, dancing, or otherwise moving their bodies along with the pre-recorded audio. For example, a video may feature a "dance challenge" that an individual completes to a hit song, or the video may feature two people participating in a lip-sync or two-person dance. As another example, a video may feature an individual completing a challenge that requires the individual to move their body to correspond to the pre-recorded audio overlay, e.g., to the beat or rhythm of a pre-recorded song that is featured by the pre-recorded audio overlay. Other videos may not include pre-recorded audio overrides. For example, these videos may feature individuals playing sports, playing pranks, or giving advice, such as beauty and fashion advice, cooking tips, home decor tips, and the like.

[0035] In one embodiment, the content 116 may be output to different client devices 104 via the network 120. The content 116 may be streamed to the client devices 104. The content stream may be a stream of video, such as short videos and / or long videos, received from the video service 112. Multiple client devices 104 may be configured to access the content 116 from the video service 112. In one embodiment, the client devices 104 may include a content application 106. The content application 106 outputs (e.g., displays, renders, presents) the content 116 to a user associated with the client device 104. The content may include video, audio, comments, text data, etc.

[0036] The client devices 104 may include any type of computing device, such as a mobile device, a tablet device, a laptop computer, a desktop computer, a smart television or other smart device (e.g., a smart watch, a smart speaker, smart glasses, a smart helmet), a gaming device, a set-top box, a digital streaming device, a robot, etc. The client devices 104 may be associated with one or more users. A single user may access the cloud network 102 using one or more of the client devices 104. The client devices 104 may travel to different locations and access the cloud network 102 using different networks.

[0037] The video service 112 may be configured to receive input from a user. The user may be registered as a user of the video service 112 or may be a user of a content application 106 running on a client device 104. The user input may include a short video created by the user, a user comment associated with the short video, or a "like" associated with the short video. The user input may include a connection request and user input data, such as text data, digital image data, or user content. The connection request may include a request from a client device 104a-d to connect to the video service 112. The user input data may include information, such as a video and / or a user comment, that a user connected to the short video service 112 desires to share with other connected users of the video service 112.

[0038] The video service 112 may be able to receive different types of input from users using different types of client devices 104. For example, a user using a content application 106 on a first user device, such as a mobile phone or tablet, may be able to create and upload videos using the content application 106. A user using the content application 106 on a different mobile phone or tablet may be able to view, comment on, and "like" short videos or comments written by other users. In another example, a user using the content application 106 on a smart TV, laptop, desktop, or gaming device may not be able to use the content application 106 to create and upload short videos or comment on short videos. Instead, a user using the content application 106 on a smart TV, laptop, desktop, or gaming device may only be able to use the content application 106 to view short videos, view comments left by other users, and "like" short videos.

[0039] In one embodiment, a user may use a content application 106 on a client device 104 to create a video and upload it to the cloud network 102. The client device 104 may access an interface 108 of the content application 106. The interface 108 may include input elements. For example, the input elements may be configured to allow a user to create a video. To create the video, the user may give the content application 106 permission to access an image capture device, such as a camera or a microphone, of the client device 104. Using the content application 106, the user may select the duration of the video or set the speed of the video, for example, "slow motion" or "speed up."

[0040] A user may edit a video using the content application 106. A user may add one or more text, filters, sounds, or effects, such as beauty or interactive effects, to a video. To add a pre-recorded audio overlay to a video, a user may select a song or sound clip from a sound library of the content application 106. The sound library may include different songs, sound effects, or audio clips from movies, albums, and television shows. In addition to or instead of adding a pre-recorded audio overlay to a video, a user may add narration to a video using the content application 106. The narration may be sound recorded by the user using a microphone on the client device 104. A user may add a text overlay to a video and may specify when they want the text overlay to appear in the video using the content application 106. A user may assign a caption, a location tag, and one or more hashtags to a video to indicate the subject of the video. The content application 106 may prompt the user to select a frame of the video to use as a "cover image" for the video.

[0041] After a user creates a video, the user may use the content application 106 to upload the video to the cloud network 102 and / or store the video locally on the user device 104. When a user uploads a video to the cloud network 102, the user may select whether the video is viewable by all other users of the content application 106 or by only a subset of users of the content application 106. The video service 112 may store the uploaded video and any metadata associated with the video in one or more databases 114.

[0042] In one embodiment, a user may provide input on a video using a content application 106 on a client device 104. The client device 104 may access an interface 108 of the content application 106 that allows the user to provide input associated with the video. The interface 108 may include an input element. For example, the input element may be configured to receive input from a user, such as a comment or a "like" associated with a particular video. If the input is a comment, the content application 106 may allow the user to set an emoji to be associated with their input. The content application 106 may determine time information about the input, such as when the user wrote the comment. The content application 106 may transmit the input and associated metadata to the cloud network 102. For example, the content application 106 may transmit the comment, an identifier of the user who wrote the comment, and time information about the comment to the cloud network 102. The video service 112 may store the input and associated metadata in a database 114.

[0043] The video service 112 may be configured to output uploaded videos and user inputs to other users. A user may be registered as a user of the video service 112 and view videos created by other users. The user may be a user of a content application 106 running on a client device 104. The content application 106 may output (display, render, present) the videos and user comments to a user associated with the client device 104. The client device 104 may access an interface 108 of the content application 106. The interface 108 may include an output element. The output element may be configured to display information about different videos so that a user can select and watch the videos. For example, the output element may be configured to display multiple cover images, subtitles, or hashtags associated with the videos. The output element may also be configured to arrange the videos according to a category associated with each video.

[0044] In one embodiment, user comments associated with a video may be output to other users viewing the same video. For example, all users accessing the video may see the comments associated with the video. The video service 112 may output the comments associated with the video simultaneously. The comments may be output by the video service 112 in real-time or near real-time. The content application 106 may display the video and comments on the client device 104 in a variety of ways. For example, the comments may be displayed in an overlay on top of the content or next to the content. As another example, a user who wants to see other users' comments associated with the video may need to select a button to view the comments. The comments may be animated when displayed. For example, the comments may scroll across the video or across an overlay.

[0045] In one embodiment, a user may create a video in the content application 106 with interactive effects selected from a number of interactive effects provided by the video service 112. Each interactive effect may include overlaying at least one component on at least a subset of the frames of the video. The interactive effects may be developed using the Effect SDK and the LUA scripting language. For example, the components may include one or more 2D or three-dimensional (3D) computer-generated graphics. Any 2D or 3D UI components may be rendered on the video as a separate layer, for example, using Helium (the engine) and Lynx (the framework). Defining these UI components on this layer predefines how a viewer will "interact" with another user's effect video.

[0046] The interactive effects allow the video to be interacted with by other users of the plurality of users. After the video is created with the interactive effects, the video may be uploaded to the cloud network 102 and / or the video may be stored locally on the user device 104. The video service 112 may be configured to output the uploaded video created with the interactive effects to other users who are registered as users of the video service 112. The other users may consume the video created with the interactive effects, and the other users may interact with the video. For example, when the other users interact with the video, an animation associated with at least one overlay component may be triggered.

[0047] For example, a video created with interactive effects may be sent to the video service 112 when it is published. The video service 112 may use Helium and Lynx to render JavaScript applications on the video. The Lynx Canvas uses Helium to draw with native rendering capabilities. As the viewer watches the video, the viewer may be asked to make gestures on the video. When the viewer triggers a gesture, the Interaction API gets this information and notifies the client to use Lynx to render additional 2D or 3D animations on the video using the Rendering API.

[0048] In some embodiments, a user may create a video using the content application 106 with multiple effects. The multiple effects may include one or more interactive effects selected from a plurality of interactive effects provided by the video service 112. For example, a first portion of the video may be created with a first effect and a second portion of the video may be created with a second, different effect. The first effect and / or the second effect may be interactive effects that allow a viewer of the video to "interact" with the video. For example, if the first effect is interactive but the second effect is not, a viewer of the video may be able to interact with the video during the first portion of the video but not during the second portion of the video. If both the first effect and the second effect are interactive, a viewer of the video may be able to interact with the video in a first way corresponding to the first effect during the first portion of the video and may be able to interact with the video in a second way corresponding to the second effect during the second portion of the video. A single video may be created with any number of interactive or other effects.

[0049] The computing nodes 118 may process tasks associated with the short video service 112. The computing nodes 118 may be implemented as one or more computing devices, one or more processors, one or more virtual computing instances, combinations thereof, and the like. The computing nodes 118 may be implemented by one or more computing devices. The computing devices may include virtualized computing instances. The virtualized computing instances may include virtual machines, such as emulations of computer systems, operating systems, servers, and the like. The virtual machines may be loaded by the computing devices based on a virtual image and / or other data that defines the specific software for the emulation (e.g., operating system, dedicated application, server). As the demand for different types of processing services changes, different virtual machines may be loaded and / or terminated on one or more computing devices. A hypervisor may be implemented to manage the use of different virtual machines on the same computing device.

[0050] As described above, a user may use a content application 106 on a client device 104 to create and upload a video to the cloud network 102. In some embodiments, a user may create a video with interactive effects selected from a plurality of interactive effects provided by the video service 112. The video created with the interactive effects may be interacted with by viewers of the video. FIG. 2 illustrates an example of a user interface (UI) 200 of the content application 106. A user of a client device 104a-d may use the UI 200 to create a video with interactive effects. For example, a user may select an effects icon 202. If a user selects the effects icon 202, a user may select an effect from a plurality of different effect options. One or more of the effect options may be interactive effects. If a user selects an interactive effect, a prompt 204 may appear on the UI 200. For example, the prompt 204 may appear if it is the user's first time creating a video with interactive effects. If the user does not want prompt 204 to appear again when the user later creates a video with interactive effects, the user may indicate so by selecting box 208. By default, box 208 may be checked. Prompt 204 may inform the user that the selected effect is interactive and that a video created with the selected effect can be interacted with by viewers of the video. The user may additionally be able to select a time to be associated with the video by selecting a time from box 206. For example, the user may indicate that they want the video to be 3 minutes, 60 seconds, 15 seconds, or any other duration.

[0051] In some embodiments, each interactive effect provided by the video service 112 is associated with its own default background. The user may be prompted to upload a picture or image to replace the default background. FIG. 3 illustrates an example of a UI 300 of a content application 106. The UI 300 includes a prompt 302. The prompt 302 may instruct the user to upload their own picture or image to change the default background associated with the selected interactive effect. If the user decides that they want to upload their own picture or image to replace the default background associated with the selected interactive effect, the user may select an upload button 304. Conversely, if the user decides that they do not want to replace the default background, the user may not want to upload their own picture / image. As a result, the user may not select the upload button 304.

[0052] 4A-7B show an example UI of a content application 106 associated with a user creating a video with a first interactive effect. As shown in FIG. 4A, a user may select an interactive effects button 402. If a user wants to see various interactive effects provided by the video service 112, the user may select the interactive effects button 402. When the user selects the button 402, various icons associated with the interactive effects provided by the video service 112 may be displayed on the UI 400. Each of the icons may correspond to a particular interactive effect provided by the video service 112. The user may select an icon 404 from the UI 400. The icon 404 corresponds to a first interactive effect. By selecting the icon 404, the user indicates that the user wants to create a video with the first interactive effect. A name 406 associated with the first interactive effect may appear on the UI 400, for example, on the top or header of the UI 400.

[0053] As mentioned above, in some embodiments, each interactive effect provided by the video service 112 is associated with its own default background. The first interactive effect may be associated with the first default background. The user may be prompted to upload a picture or image to replace the first default background. As shown in FIG. 4B, the user may scroll through various pre-created background image options in box 408 shown on UI 401. The user may additionally or alternatively upload a picture or image to replace the first default background. If the user decides that he or she wants to upload his or her own picture or image to replace the first default background associated with the first interactive effect, the user may select the upload button in box 408. Conversely, if the user decides that he or she does not want to replace the first default background, the user may not want to upload his or her own picture / image. As a result, the user may not select the upload button in box 408.

[0054] In some embodiments, after a background is selected (by default or otherwise), a user's body part (e.g., the user's face) may be placed on a two-dimensional (2D) or three-dimensional (3D) component that is overlaid on the at least one subset of frames of the video. For example, the two-dimensional (2D) or three-dimensional (3D) component may be a dancing body holding a bottle and / or a glass. Before the user begins taking a photo or video, the user's body part may be placed on the 2D character. For example, as shown in the UI 500 of FIG. 1, the 2D character may be a dancing character 502 holding a bottle. The user's face 504 may be placed on the dancing character's face such that the user's face appears to be attached to the dancing body.

[0055] A client device 104 associated with UI 500 may use a feed captured by a camera of the client device 104 to detect (e.g., locate) one or more parts of an object, such as one or more body parts of a user. For example, the client device 104 may use the feed captured by the camera to detect the head or face of a user. The one or more body parts detected by the camera may include a body part that is placed on a 2D character.

[0056] In some embodiments, an interaction associated with the first interactive effect may be simulated after a body part of the user (e.g., the user's face 504) is placed on the 2D character 502, but before the user starts taking a picture or a video. For example, an interaction between a viewer and a video already created with the first interactive effect may be simulated. In this manner, a user creating a video may experience the interaction and decide whether or not he or she wants to create his or her video with the first interactive effect. Text may be displayed on the UI 500 indicating that viewers of the video will also be able to interact with the video. Instructions 506 may appear on the UI 500. Instructions 506 may include text and / or graphic instructions instructing the user how to interact with the video. For example, instructions 506 may include text instructing the user to shake the client device 104. The UI 500 may also include text and / or graphics reminding the user that viewers will be able to interact with the video in the same manner (e.g., by shaking a phone).

[0057] When the user follows the instructions provided by the instructions 506, an animation associated with the 2D character 502 may be triggered. For example, when the user shakes the client device 104, a bottle held by the 2D character may appear to pop and / or squirt, as shown in the UI 501 illustrated in FIG. 5B. In some embodiments, when the user follows the instructions provided by the instructions 506, the output of a sound may additionally or alternatively be triggered. The sound may correspond to an animation associated with the 2D character 502. For example, the sound may be a "popping cork" sound corresponding to a bottle popping on the UI 501. The user may record a video having a first interactive effect. To record a video having a first interactive effect, the user may select a start record button 510.

[0058] The user can record a video with the first interactive effect. In some embodiments, a message or instruction may appear reminding the user to verbally instruct viewers how to interact with the video. For example, the user may be reminded that while recording the video, the user should verbally instruct the users to shake their cell phone to be surprised. While the video is being recorded, the user can make various facial expressions that they want to be displayed on the head of the 2D character dancing and holding the bottle and / or glass. However, the 2D dancing character may not be able to be repositioned or scaled. While the user is recording the video, the user may not be able to see the interaction associated with the first interactive effect. Text may be displayed on the UI reminding the user that viewers of the video will be able to interact with the video. When the user ends the recording, the user can select the end recording button 602 shown in the UI 600 of FIG. 6A. When the user ends the recording, the user can preview the video created with the first interactive effect, as indicated by the UI 601 illustrated in FIG. 6B. When a user previews a video created with the first interactive effect, the user may not be able to interact with the video.

[0059] As described above, after a user creates a video with the first interactive effect, the user may use the content application 106 to upload the video created with the first interactive effect to the cloud network 102 and / or store the video locally on the user device 104. When the user uploads the video created with the first interactive effect to the cloud network 102, the user may select whether the video is viewable by all other users of the content application 106 or by only a subset of users of the content application 106. The video service 112 may store the uploaded video created with the first interactive effect and any associated metadata in one or more databases 114.

[0060] The video service 112 may be configured to output the uploaded video created with the first interactive effect to other users for viewing. The other users may view the video created with the first interactive effect on the interface 108 of the content application 106. FIGS. 7A-7B show UIs 700-701 illustrating different users viewing the uploaded video created with the first interactive effect. A prompt 702 may appear on the UI 700 while the different users are viewing the uploaded video created with the first interactive effect. The prompt 702 may instruct the different users on how to interact with the video. For example, the prompt 702 may instruct the different users to shake the client device 104 on which the different users are viewing the video.

[0061] If the different users follow the instructions provided by the instructions 702, an animation associated with a 2D character featured in the video may be triggered. For example, when the different users shake the client device 104, a bottle held by the 2D character may appear to pop and / or squirt, as shown in the UI 701. In some embodiments, if the different users follow the instructions provided by the instructions 702, the output of a sound may additionally or alternatively be triggered. The sound may correspond to an animation associated with the 2D character. For example, the sound may be a "popping cork" sound corresponding to a bottle being popped on the UI 701.

[0062] 8-13 illustrate an example UI of the content application 106 associated with a user creating a video with a second, different interactive effect. As shown in FIG. 8, a user may select an interactive effects button 402. If a user wants to view various interactive effects provided by the video service 112, the user may select the interactive effects button 402. When the user selects the button 402, various icons associated with the interactive effects provided by the video service 112 may be displayed on the UI 800. Each of the icons may correspond to a particular interactive effect provided by the video service 112. The user may select an icon 804 from the UI 800. The icon 804 corresponds to a second interactive effect. The second interactive effect is different from the first interactive effect described above. By selecting the icon 804, the user indicates that the user wants to create a video with the second interactive effect. A name 806 associated with the second interactive effect may appear on the UI 800, for example, on the top or header of the UI 800.

[0063] As mentioned above, in some embodiments, each interactive effect provided by the video service 112 is associated with its own default background. A second interactive effect may be associated with a second default background. The user may be prompted to upload a picture or image to replace the second default background. As shown in FIG. 8, the user may scroll through various pre-created background image options in a box 808 shown on the UI 800. The user may additionally or alternatively upload a picture or image to replace the second default background. If the user decides that he or she wants to upload his or her own picture or image to replace the second default background associated with the second interactive effect, the user may select the upload button in the box 808. Conversely, if the user decides that he or she does not want to replace the second default background, the user may not want to upload his or her own picture / image. As a result, the user may not select the upload button in the box 808.

[0064] In some embodiments, after a background is selected (by default or otherwise), the user may be prompted to draw a 2D or 3D component, such as a bubble, on his / her screen. The 2D or 3D component may be overlaid on at least a subset of the frames of the video. As shown in FIG. 9, a prompt 902 may appear on the UI 900. The prompt 902 instructs the user to draw a bubble on his / her screen, for example, using a paint brush. The user may be prevented from drawing on an existing button on the UI 900. During the drawing step, the user may be warned or informed that the bubble will cover his / her video created with this second interactive effect. Text may be displayed on the UI 900 informing the user that the bubble will only appear after the user publishes the video. During the drawing step, the user may be able to erase and / or redraw one or more bubbles that the user has already drawn.

[0065] In some embodiments, after the 2D or 3D components are drawn and before the user starts taking a picture or a video, an interaction associated with the second interactive effect may be simulated. For example, a viewer's interaction with a video already created with the second interactive effect may be simulated. In this way, a user creating a video may experience the interaction and decide whether or not he or she wants to create his or her video with the second interactive effect. As shown in FIG. 10, the second interactive effect may be simulated by covering the UI 1000 with bubbles drawn by the user. Instructions 1006 may appear on the UI 1000. The instructions 1006 may include text and / or graphic instructions that inform the user how to interact with the video. For example, the instructions 1006 may include text instructing the user to tap the screen of the client device 104 to pop the already drawn bubbles. The UI 1000 may also include text and / or graphics that remind the user that the viewer will be able to interact with the video in the same way (e.g., by tapping to pop the bubbles).

[0066] If the user follows the instructions provided by the instructions 1006, an animation associated with the 2D or 3D component may be triggered. For example, when the user taps the screen of the client device 104, a bubble drawn by the user may appear to pop or break. In some embodiments, if the user follows the instructions provided by the instructions 1006, the output of a sound may additionally or alternatively be triggered. The sound may correspond to an animation associated with the 2D or 3D component. For example, the sound may be a "popping bubble" sound corresponding to a popping bubble. The user may record a video having a second interactive effect. To record a video having a second interactive effect, the user may select the start record button 1010.

[0067] The user can record a video with the second interactive effect. FIG. 11A shows a UI 1100 illustrating a user recording a video. When the user starts recording the video, the bubble may disappear and the user can record the video with this effect as if it were a normal green screen effect. In some embodiments, a message or instruction may appear reminding the user to verbally instruct the viewer how to interact with the video. For example, while recording the video, the user may remind the user that they should verbally instruct the users to tap the screen to pop the bubble and be surprised. For example, the user may verbally instruct the viewers to pop the bubble to see the user's outfit in the video.

[0068] When the user ends the recording, the user may select an end recording button 1106 shown in UI 1100 of FIG. 11A. When the user ends the recording, the user may preview the video created with the second interactive effects, as indicated by UI 1101 illustrated in FIG. 11B. When the user previews the video created with the second interactive effects, the user may not be able to interact with the video. For example, the user may not be able to see the bubbles when previewing the video.

[0069] As described above, after the user creates the video with the second interactive effects, the user may use the content application 106 to upload the video created with the second interactive effects to the cloud network 102 and / or store the video locally on the user device 104. When the user uploads the video created with the second interactive effects to the cloud network 102, the user may select whether the video is viewable by all other users of the content application 106 or by only a subset of users of the content application 106. The video service 112 may store the uploaded video created with the second interactive effects and any associated metadata in one or more databases 114.

[0070] The video service 112 may be configured to output the uploaded video created with the second interactive effects to other users for viewing. The other users may view the video created with the second interactive effects on the interface 108 of the content application 106. FIGS. 12A-12B show UIs 1200-1201 illustrating different users viewing the uploaded video created with the second interactive effects. A prompt 1202 may appear on the UI 1200 while the different users are viewing the uploaded video created with the second interactive effects. The prompt 1202 may instruct the different users on how to interact with the video. For example, the prompt 1202 may instruct the different users to tap on the screen of the client device 104 on which the different users are viewing the video to pop a bubble.

[0071] When the different users follow the instructions provided by instructions 1202, an animation associated with the 2D or 3D component featured in the video may be triggered. For example, when the different users tap the screen of the client device 104, a bubble may appear to pop or break, as shown in the UI 1201. In some embodiments, when the different users follow the instructions provided by instructions 1202, the output of a sound may additionally or alternatively be triggered. The sound may correspond to an animation associated with the 2D or 3D component. For example, the sound may be a "popping bubble" sound corresponding to a popping bubble on the UI 1201.

[0072] In some embodiments, different users must tap on the bubbles to pop them. After different users tap on the screen a predetermined number of times (e.g., three times), all the bubbles may automatically pop and float upward on the UI 1202. Once the bubbles float upward, a predetermined image and / or a predetermined message may be displayed. For example, FIG. 13 shows a UI 1300 depicting an image 1302 that is displayed after the bubbles float off the screen. The image 1302 may be a logo or any other image. A message may be displayed in addition or as an alternative.

[0073] 14 illustrates an example process 1400 performed by a video service (e.g., video service 112). Video service 112 may perform process 1400 to increase user interaction with delivered content. Although illustrated as a series of operations in FIG. 14, one skilled in the art will recognize that various embodiments may add, remove, reorder, or modify the described operations.

[0074] At 1402, a video may be received from a first computing device associated with a first one of the plurality of users. The plurality of users may be, for example, registered users of the video service 112. The received video may have been generated using interactive effects. For example, the first user may have created a video using the first or second interactive effects described above with respect to FIGS. 4A-13. The interactive effects may include overlaying at least one component on at least a subset of the frames of the video. The at least one component may include at least one of a two-dimensional computer-generated graphic or a three-dimensional computer-generated graphic. For example, the at least one component may include a dancing character with a bottle and a glass and / or bubbles, as described above. The interactive effects allow the video to be interacted with by other one of the plurality of users.

[0075] At 1404, the video may be presented on a second computing device associated with a second user of the plurality of users. For example, output of the video may be triggered via the second computing device. The second user may consume or view the video on the second computing device. The video may include information indicating instructions on how to interact with the video. For example, presenting the video on the second computing device may include outputting text on an interface of the second computing device. The text may include instructions on how the second user interacts with the video. For example, the text may instruct the second user to shake or rotate the second computing device. As another example, the text may instruct the second user to perform at least one user gesture (e.g., tap, swipe, click) on the interface of the second computing device.

[0076] At 1406, in response to receiving an indication of an interaction with the video by the second user, an animation associated with the at least one component on the second computing device may be automatically triggered. For example, when the second user follows the instructions (shaking or rotating the second computing device or performing at least one user gesture), an animation associated with the at least one component may be triggered. For example, as described above in connection with FIG. 7B, when the second user shakes the second computing device, a bottle held by the 2D character may appear to pop and / or squirt. As another example, as described above in connection with FIG. 12B, when the second user taps the screen of the second computing device, a bubble may appear to pop or break.

[0077] In response to viewing the video, the second user may wish to create his or her own video with interactive effects. The second user may create a new video with interactive effects and upload the new video, for example, to the video service 112, for distribution to other users of the video service 112. The video service 112 may receive the new video from a second computing device associated with the second user and present the new video to the other users of the video service 112. For example, the new video may be presented at a third computing device associated with a third user of the plurality of users. The second video may include information indicating instructions on how to interact with the video.

[0078] 15 illustrates an example process 1500 performed by a video service (e.g., video service 112). Video service 112 may perform process 1500 to increase user interaction with delivered content. Although illustrated as a series of operations in FIG. 15, one skilled in the art will appreciate that in various embodiments, the described operations may be added, removed, reordered, or modified.

[0079] At 1502, a video may be received from a first computing device associated with a first one of the plurality of users. The plurality of users may be, for example, registered users of the video service 112. The received video may have been generated using interactive effects. For example, the first user may have created a video using the first or second interactive effects described above with respect to FIGS. 4A-13. The interactive effects may include overlaying at least one component on at least a subset of the frames of the video. The at least one component may include at least one of a two-dimensional computer-generated graphic or a three-dimensional computer-generated graphic. For example, the at least one component may include a dancing character with a bottle and a glass and / or bubbles, as described above. The interactive effects allow the video to be interacted with by other one of the plurality of users.

[0080] At 1504, the video may be presented on a second computing device associated with a second user of the plurality of users. For example, output of the video may be triggered via the second computing device. The second user may consume or view the video on the second computing device. The video may include information indicating instructions on how to interact with the video. For example, presenting the video on the second computing device may include outputting text on an interface of the second computing device. The text may include instructions on how the second user interacts with the video. For example, the text may instruct the second user to shake or rotate the second computing device. As another example, the text may instruct the second user to perform at least one user gesture (e.g., tap, swipe, click) on the interface of the second computing device.

[0081] At 1506, in response to receiving an indication of an interaction with the video by the second user, an animation associated with the at least one component on the second computing device may be automatically triggered. For example, when the second user follows the instruction (shaking or rotating the second computing device or performing at least one user gesture), an animation associated with the at least one component may be triggered. For example, as described above in connection with FIG. 7B, when the second user shakes the second computing device, a bottle held by the 2D character may appear to pop and / or squirt. As another example, as described above in connection with FIG. 12B, when the second user taps the screen of the second computing device, a bubble may appear to pop or break.

[0082] At 1508, the output of a sound corresponding to the movement of the at least one component may be triggered. For example, as described above in connection with FIG. 7B, the sound may correspond to an animation associated with the 2D character 502. For example, the sound may be a "popping cork" sound corresponding to a bottle popping. As another example, as described above in connection with FIG. 12B, the sound may correspond to an animation associated with a bubble. For example, the sound may be a "popping bubble" sound corresponding to a bubble popping. At 1510, the display of at least one of a predetermined image or a predetermined message may be triggered after the display of the animation associated with the at least one component. For example, as described above in connection with FIG. 13, the image may be a logo or any other image. A message may be displayed in addition or alternatively.

[0083] 16 illustrates an example process 1600 performed by a video service (e.g., video service 112). Video service 112 may perform process 1600 to increase user interaction with delivered content. Although illustrated as a series of operations in FIG. 16, one skilled in the art will appreciate that in various embodiments, the described operations may be added, removed, reordered, or modified.

[0084] At 1602, information may be sent to display a first interface on a first computing device associated with a first one of the users. The multiple users may be, for example, registered users of the video service 112. The first interface includes information associated with an interactive effect. The interactive effect allows a video created with the interactive effect to be interacted with other users of the multiple users. The interactive effect may include overlaying at least one component on at least a subset of frames of the video. The at least one component may include at least one of a two-dimensional computer-generated graphic or a three-dimensional computer-generated graphic. For example, the at least one component may include a dancing character with a bottle and a glass and / or bubbles, as described above. The interactive effect allows a video to be interacted with other users of the multiple users.

[0085] As described above, the first user may create a video with an interactive effect selected from a plurality of interactive effects provided by the video service 112. When the user selects an interactive effect that the user would like to use in creating the video, a prompt may appear on an interface of a first computing device associated with the first user. For example, the prompt may appear if it is the user's first time creating a video with an interactive effect. In some embodiments, each interactive effect provided by the video service 112 is associated with its own default background. The first user may be prompted to upload a picture or image to replace the default background. If the user decides that he or she would like to upload his or her own picture or image to replace the default background associated with the selected interactive effect, the user may do so. Conversely, if the user decides that he or she does not want to replace the default background, the user may not want to upload his or her own picture / image.

[0086] At 1604, information may be displayed that reminds the first user to include instructional content in the video. The instructional content instructs other users of the plurality of users how to interact with the video. For example, the display may cause a message or instruction to be displayed that reminds the first user to verbally instruct the viewer how to interact with the video. For example, the first user may be reminded that during recording of the video, the first user should verbally instruct the viewer to shake, rotate, or perform at least one user gesture (e.g., tap, swipe, click) on the interface of the viewer's computing device.

[0087] At 1606, a simulation of an interaction may be triggered on the first computing device during the process of generating the video with the interactive effects. For example, an interaction associated with the interactive effects may be simulated before the first user actually begins taking pictures or videos. For example, an interaction between a viewer and a video already created with the interactive effects may be simulated. In this manner, a first user creating a video may experience the interaction and decide whether or not he or she wants to create his or her own video with the interactive effects. Text may be displayed on the interface of the first computing device indicating that viewers of the video will also be able to interact with the video.

[0088] Simulating the interaction may include causing the display of instructions including text and / or graphic instructions instructing the first user how to interact with the video. For example, the instructions may include text instructing the first user to shake, rotate, or perform at least one user gesture (e.g., tap, swipe, click) on an interface of the first computing device. The interface may also include text and / or graphics reminding the first user that a viewer will be able to interact with the video in the same manner. If the user follows the instructions provided by the instructions, an animation associated with the at least one component may be caused on the first computing device. In some embodiments, if the first user follows the instructions provided by the instructions, the output of a sound may additionally or alternatively be caused. The sound may correspond to an animation associated with the at least one component.

[0089] At 1608, a display of a second interface may be caused on the first computing device. The second interface may be configured such that elements associated with the at least one component may be created, edited, or deleted by the first user. For example, as described above in connection with FIG. 9, the user may be able to erase and / or redraw one or more bubbles that the user has already drawn. At 1610, a video may be received from the first computing device. The received video may have been generated using interactive effects. For example, the first user may have created a video using the first or second interactive effects described above in connection with FIGS. 4A-13. At 1612, the video may be presented on a second computing device associated with a second one of the users. For example, output of the video may be caused via the second computing device. The second user may consume or view the video on the second computing device. The video may include information indicating instructions on how to interact with the video. For example, presenting the video on the second computing device may include outputting text on an interface of the second computing device. The text may include instructions regarding how the second user should interact with the video. For example, the text may instruct the second user to shake or rotate the second computing device. As another example, the text may instruct the second user to perform at least one user gesture (e.g., tap, swipe, click) on the interface of the second computing device.

[0090] At 1614, in response to receiving an indication of an interaction with the video by the second user, the display of an animation associated with the at least one component on the second computing device may be automatically triggered. For example, when the second user follows the instructions (shaking or rotating the second computing device or performing at least one user gesture), the animation associated with the at least one component may be triggered. For example, as described above in connection with FIG. 7B, when the second user shakes the second computing device, a bottle held by the 2D character may appear to pop and / or squirt. As another example, as described above in connection with FIG. 12B, when the second user taps the screen of the second computing device, a bubble may appear to pop or break.

[0091] Figure 17 illustrates a computing device that may be used in various aspects, such as the services, networks, modules, and / or devices illustrated in Figure 1. With respect to the example architecture of Figure 1, the message service, interface service, processing service, content service, cloud network, and clients may each be implemented by one or more instances of computing device 1700 of Figure 17. The computer architecture illustrated in Figure 17 illustrates a conventional server computer, workstation, desktop computer, laptop computer, tablet, network appliance, PDA, e-reader, digital mobile phone, or other computing node that may be used to perform any aspect of the computer described herein, such as implementing the methods described herein.

[0092] Computing device 1700 may include a substrate or "motherboard," which is a printed circuit board that can be connected to multiple components or devices via a system bus or other electrical communication paths. One or more central processing units (CPUs) 1704 may operate in conjunction with a chipset 1706. CPU 1704 may be a standard programmable processor that performs arithmetic and logical operations necessary for the operation of computing device 1700.

[0093] The CPU 1704 may transition from one discrete physical state to the next and perform the necessary operations by manipulating switching elements that distinguish between these states. Switching elements may typically include electronic circuits, such as flip-flops, that maintain one of two binary states, and electronic circuits, such as logic gates, that provide an output state based on a logical combination of the states of one or more other switching elements. These basic switching elements may be combined to create more complex logic circuits, including registers, adders and subtractors, arithmetic logic units, floating point units, etc.

[0094] CPU 1704 may be augmented or replaced by other processing units, such as GPUs, which may include processing units specialized, but not necessarily limited to, highly parallel computations, such as graphics and other visualization-related processing.

[0095] The chipset 1706 may provide an interface between the CPU 1704 and the remaining components and devices on the board. The chipset 1706 may provide an interface to a random access memory (RAM) 1708 used as the main memory in the computing device 1700. The chipset 1706 may also provide an interface to a computer-readable storage medium, such as a read-only memory (ROM) 1720 or a non-volatile RAM (NVRAM) (not shown), for storing basic routines that may facilitate starting the computing device 1700 and transmitting information between various components and devices. According to aspects described herein, the ROM 1720 or the NVRAM may store other software components necessary for the operation of the computing device 1700.

[0096] The computing device 1700 may operate in a networked environment using logical connections to remote computing nodes and computer systems via a local area network (LAN). The chipset 1706 may include functionality for providing network connectivity via a network interface controller (NIC) 1722, such as a Gigabit Ethernet adapter. The NIC 1722 may be capable of connecting the computing device 1700 to other computing nodes via the network 1716. It should be understood that multiple NICs 1722 may be present within the computing device 1700 to connect the computing device to other types of networks and remote computer systems.

[0097] The computing device 1700 may be connected to a mass storage device 1728 that provides non-volatile storage for the computer. The mass storage device 1728 may store system programs, application programs, other program modules, and data, as described in more detail herein. The mass storage device 1728 may be connected to the computing device 1700 through a storage controller 1724 that is connected to the chipset 1706. The mass storage device 1728 may be comprised of one or more physical storage units. The mass storage device 1728 may include a management component 1710. The storage controller 1724 may interface with the physical storage units through a Serial Attached SCSI (SAS) interface, a Serial Advanced Technology Attachment (SATA) interface, a Fibre Channel (FC) interface, or any other type of interface for physically connecting and transmitting data between the computer and the physical storage units.

[0098] Computing device 1700 may store data on mass storage device 1728 by transforming the physical state of the physical storage units to reflect the information being stored. The particular transformation of the physical state may depend on a variety of factors and different implementations of the present specification. Examples of such factors include, but are not limited to, the technology for implementing the physical storage device and whether mass storage device 1728 is characterized as a primary storage device, a secondary storage device, etc.

[0099] For example, the computing device 1700 may store information in the mass storage device 1728 by issuing instructions via the storage controller 1724 to change the magnetic properties of a particular location in a magnetic disk drive unit, the reflective or refractive properties of a particular location in an optical storage unit, or the electrical properties of a particular capacitor, transistor, or other discrete component in a solid-state storage unit. Other transformations of physical media are possible without departing from the scope and spirit of this specification, and the foregoing examples are provided merely for ease of explanation thereof. The computing device 1700 may further read information from the mass storage device 1728 by detecting a physical state or characteristic of one or more particular locations in the physical storage unit.

[0100] In addition to the mass storage device 1728 discussed above, computing device 1700 may also access other computer-readable storage media for storing and retrieving information, such as program modules, data structures, or other data. Those skilled in the art will appreciate that computer-readable storage media can be any available media that provides non-transitory storage of data and that can be accessed by computing device 1700.

[0101] By way of example and not limitation, computer readable storage media may include volatile and non-volatile, transient and non-transient computer readable storage media, as well as removable and non-removable media implemented in any manner or technology, including, but not limited to, RAM, ROM, erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory or other solid state memory technology, compact disc ROM (CD-ROM), digital versatile disc (DVD), high definition DVD ("HD-DVD"), BLU-RAY or other optical storage, magnetic cassettes, magnetic tapes, magnetic disk storage, other magnetic storage devices, or any other medium that can be used to store the desired information in a non-transitory manner.

[0102] A mass storage device, such as mass storage device 1728 shown in FIG. 17, may store an operating system for controlling the operation of computing device 1700. The operating system may include a version of the LINUX operating system. The operating system may include a version of Microsoft's WINDOWS SERVER operating system. According to another aspect, the operating system may include a version of the UNIX operating system. Also, various mobile phone operating systems, such as IOS and ANDROID, may be utilized. It should be understood that other operating systems may also be utilized. Mass storage device 1728 may store other system or applications and data used by computing device 1700.

[0103] The mass storage device 1728 or other computer-readable storage medium may also be encoded with computer-executable instructions that, when loaded into computing device 1700, transform the computing device from a general-purpose computing system to a special-purpose computer capable of implementing aspects described herein. As described above, these computer-executable instructions transform computing device 1700 by defining how CPU 1704 transitions between states. Computing device 1700 may have access to a computer-readable storage medium that stores computer-executable instructions that, when executed by computing device 1700, can perform the methods described herein.

[0104] A computing device, such as the computing device 1700 shown in Figure 17, may further include an input / output controller 1732 for receiving and processing input from multiple input devices, such as a keyboard, a mouse, a touchpad, a touch screen, an electronic stylus pen, or other type of input device. Similarly, the input / output controller 1732 may provide output to a display, such as a computer monitor, a flat panel display, a digital projector, a printer, a plotter, or other type of output device. It should be understood that the computing device 1700 may not include all of the components shown in Figure 17, may include other components not explicitly shown in Figure 17, or may utilize an entirely different architecture than that shown in Figure 17.

[0105] As described herein, a computing device may be a physical computing device, such as computing device 1700 of Figure 17. A computing node may also include a virtual machine host process and one or more virtual machine instances. Computer-executable instructions may be executed indirectly by the physical hardware of the computing device by interpreting and / or executing instructions that are stored and executed within the context of a virtual machine.

[0106] It should be understood that the methods and systems are not limited to particular methods, components, or implementations, and it should also be understood that the terminology used herein is used for the purpose of describing particular embodiments only, and is not intended to be limiting.

[0107] As used in the specification and the appended claims, the singular forms "1," "one," and "the" include plural referents unless the context clearly dictates otherwise. Ranges may be expressed herein as from "about" one particular value, and / or to "about" another particular value. When such a range is expressed, another embodiment includes the range from the one particular value and / or to the other particular value. Similarly, when values ​​are expressed as approximations, by use of the antecedent "about," it is to be understood that the particular value forms another embodiment. It is further to be understood that the endpoints of each of the ranges are significant both relative to the other endpoint and independently of the other endpoint.

[0108] "Optional" or "optionally" means that the subsequently described event or circumstance may or may not occur, and the specification includes cases where said event or circumstance occurs and cases where said event or circumstance does not occur.

[0109] Throughout the description and claims of this specification, the word "comprise" and variations of that word, such as "including" and "including," mean "including, but not limited to," and are not intended to exclude, for example, other elements, integers, or steps. "Exemplary" denotes "an example of," and is not intended to convey an indication of a preferred or desirable embodiment. "Such as" is used for purposes of interpretation rather than a limiting sense.

[0110] Components are described that can be used to perform the described methods and systems. In describing combinations, subsets, interactions, groups, etc. of these components, specific references to each of the various individual and collective combinations and permutations of these components may not be explicitly described, and each of which is specifically contemplated and described herein for all methods and systems. This applies to all aspects of this application, including but not limited to the operations in the described methods. Thus, if there are various additional operations that can be performed, it should be understood that each of these additional operations can be performed in any particular embodiment or combination of embodiments of the described methods.

[0111] The present method and system may be more readily understood by reference to the following detailed description of the preferred embodiments and examples contained therein, and the accompanying drawings and their descriptions.

[0112] As will be appreciated by those skilled in the art, the method and system may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the method and system may take the form of a computer program product on a computer-readable storage medium having computer-readable program instructions (e.g., computer software) embodied in the storage medium. More specifically, the method and system may take the form of web-implemented computer software. Any suitable computer-readable storage medium may be utilized, including hard disks, CD-ROMs, optical storage devices, or magnetic storage devices.

[0113] Embodiments of the methods and systems are described below with reference to block diagrams and flowcharts of methods, systems, devices, and computer program products. It should be understood that each block of the block diagrams and flowcharts, and combinations of blocks in the block diagrams and flowcharts, respectively, may be realized by computer program instructions. These computer program instructions may be loaded into a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute on the computer or other programmable data processing apparatus, produce means for implementing the functions specified in one or more blocks of the flowcharts.

[0114] These computer program instructions may be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner such that the instructions stored in the computer readable memory produce a product including computer readable instructions for implementing the functions defined in one or more blocks of the flowcharts. The computer program instructions may be loaded into a computer or other programmable data processing apparatus to cause the computer or other programmable data processing apparatus to perform a series of operational steps to produce a computer implemented process such that the instructions that execute on the computer or other programmable data processing apparatus provide steps for implementing the functions defined in one or more blocks of the flowcharts.

[0115] The various features and processes described above may be used independently of each other or may be combined in various ways. All possible combinations and subcombinations are intended to fall within the scope of the present disclosure. Furthermore, in some implementations, some method or process blocks may be omitted. The methods and processes described herein are not limited to any particular order, and the blocks or states associated therewith may be performed in other orders as appropriate. For example, the described blocks or states may be performed in an order other than the order specifically described, or multiple blocks or states may be combined within a single block or state. The example blocks or states may be performed sequentially, in parallel, or in some other manner. Blocks or states may be added to or deleted from the described example embodiments. The example systems and components described herein may be configured differently than described. For example, elements may be added, deleted, or rearranged as compared to the described example embodiments.

[0116] It should also be understood that while various items are shown as being stored in memory or in storage devices during use, these items or portions thereof may be transferred between memory and other storage devices for purposes of memory management and data integrity. Alternatively, in other embodiments, some or all of the software modules and / or systems may be executed in memory in another device and communicate with the illustrated computing system via computer-to-computer communications. Furthermore, in some embodiments, some or all of the systems and / or modules may be implemented or provided in other ways, such as at least partially in firmware and / or hardware, including, but not limited to, one or more application specific integrated circuits (ASICs), standard integrated circuits, controllers (e.g., by executing appropriate instructions, and including microcontrollers and / or embedded controllers), field programmable gate arrays (FPGAs), complex programmable logic devices (CPLDs), and the like. Some or all of the modules, systems, and data structures may be stored (e.g., as software instructions or structured data) on a computer-readable medium, such as a hard disk, memory, network, or portable media product, for reading by an appropriate device or via an appropriate connection. The systems, modules, and data structures may be transmitted as a generated data signal (e.g., as part of a carrier wave or other analog or digital propagated signal) over a variety of computer-readable transmission media, including wireless-based media and wire / cable-based media, which may take a variety of forms (e.g., as part of a single or multiple analog signal, or as a number of discrete digital packets or frames). In other embodiments, such computer program products may take other forms. Thus, the invention may be practiced with other computer system configurations.

[0117] While the methods and systems have been described in connection with preferred embodiments and specific examples, it is not intended that the scope be limited to the specific embodiments, as the embodiments herein are intended in all respects to be illustrative and not restrictive.

[0118] Unless expressly stated otherwise, the methods described herein do not require that their operations be performed in a particular order. Thus, where a method claim does not actually recite the order in which its operations are to be followed, or where the claims or specification are not specifically recited to limit the operations to a particular order, no order is intended to be inferred in any manner. This applies to any possible non-expressive basis for interpretation, including logical issues regarding the arrangement of steps or operational flow, the simple meaning derived from grammatical constructions and punctuation, or the number or type of embodiments described in the specification.

[0119] As will be apparent to those skilled in the art, various modifications and variations can be made without departing from the scope or spirit of the present disclosure. Other embodiments will be apparent to those skilled in the art from consideration of the specification and practice described herein. It is intended that the specification and illustrative drawings be considered as exemplary only, with its true scope and spirit being indicated by the following claims.

Claims

1. receiving a first video from a first computing device associated with a first user of a plurality of users, the first video being generated with a first interactive effect including overlaying at least one component on at least a subset of frames of the first video, the first interactive effect enabling the first video to be interacted with by other users of the plurality of users; presenting the first video at a second computing device associated with a second user of the plurality of users, the first video including information indicating instructions on how to interact with the first video; in response to receiving an indication of an interaction with the first video by the second user, causing an animation associated with the at least one component to be automatically displayed at the second computing device; The method includes:

2. causing display of at least one of a predetermined image or a predetermined message after display of the animation associated with the at least one component; The method of claim 1 further comprising:

3. transmitting information for displaying a first interface at the first computing device; The first interface includes information associated with the first interactive effect. The method of claim 1.

4. causing a simulation of an interaction on the first computing device during the process of generating the first video with the first interactive effect; The method of claim 1 further comprising:

5. causing a display of a second interface on the first computing device; The second interface is configured to allow elements associated with the at least one component to be created, edited, or deleted by the first user. The method of claim 1.

6. and causing a display of information reminding the first user to include instructional content in the first video, the instructional content instructing the other users of the plurality of users how to interact with the first video. The method of claim 1.

7. The at least one component includes at least one of a two-dimensional computer-generated graphic or a three-dimensional computer-generated graphic. The method of claim 1.

8. Receiving the indication of an interaction with the first video by the second user includes: receiving information indicating that the second user has already shook or rotated the second computing device; or receiving information indicating that the second user has already performed at least one user gesture on an interface of the second computing device; The method of claim 1 further comprising:

9. Causing an animation associated with the at least one component to be automatically displayed on the second computing device includes: moving said at least one component over an interface of said second computing device; The method of claim 1 further comprising:

10. causing an output of a sound corresponding to the movement of said at least one component; The method of claim 9 further comprising:

11. receiving a second video generated with the first interactive effect from the second computing device; presenting the second video at a third computing device associated with a third user of the plurality of users, the second video including information indicating instructions on how to interact with the second video; The method of claim 1 further comprising:

12. The first video is also generated with a second interactive effect, the second interactive effect including overlaying at least one other component on at least one other subset of frames of the first video, the second interactive effect enabling the first video to be interacted with the other users of the plurality of users. The method of claim 1.

13. 1. A system comprising at least one processor in communication with at least one memory, The at least one memory includes computer readable instructions that, when executed by the at least one processor, cause the at least one processor to: receiving a video from a first computing device associated with a first user of a plurality of users, the video being generated with an interactive effect including overlaying at least one component on at least a subset of frames of the video, the interactive effect enabling the video to be interacted with by other users of the plurality of users; presenting the video at a second computing device associated with a second user of the plurality of users, the video including information indicating instructions on how to interact with the video; in response to receiving an indication of an interaction with the video by the second user, causing an animation associated with the at least one component to be automatically displayed at the second computing device; Perform an operation that includes system.

14. The operation comprises: causing display of at least one of a predetermined image or a predetermined message after display of the animation associated with the at least one component; The system of claim 13 further comprising:

15. The operation comprises: causing a simulation of an interaction on the first computing device during the process of generating the video with the interactive effect; The system of claim 13 further comprising:

16. The operation comprises: causing a display of information reminding the first user to include instructional content in the video; The instructional content instructs the other users of the plurality of users how to interact with the video. The system of claim 13.

17. A non-transitory computer-readable storage medium having computer-readable instructions stored thereon, comprising: The computer readable instructions, when executed by a processor, cause the processor to: receiving a video from a first computing device associated with a first user of a plurality of users, the video being generated with an interactive effect including overlaying at least one component on at least a subset of frames of the video, the interactive effect enabling the video to be interacted with by other users of the plurality of users; presenting the video at a second computing device associated with a second user of the plurality of users, the video including information indicating instructions on how to interact with the video; in response to receiving an indication of an interaction with the video by the second user, causing an animation associated with the at least one component to be automatically displayed at the second computing device; A non-transitory computer-readable storage medium that performs operations including:

18. The operation comprises: causing display of at least one of a predetermined image or a predetermined message after display of the animation associated with the at least one component; 20. The non-transitory computer readable storage medium of claim 17, further comprising:

19. The operation comprises: causing a simulation of an interaction on the first computing device during the process of generating the video with the interactive effect; 20. The non-transitory computer readable storage medium of claim 17, further comprising:

20. The operation comprises: causing a display of information reminding the first user to include instructional content in the video; The instructional content instructs the other users of the plurality of users how to interact with the video.

20. The non-transitory computer-readable storage medium of claim 17.

Citation Information

Patent Citations

  • Interactive method and device applied to live streaming

    JP2018029325A