Methods, systems, and media for presenting media content items with aggregated timed reactions
By grouping and presenting reactions associated with media content items, the problem of difficulty in conveying real-time emotions and reactions in the prior art is solved, and convenient emotional communication and interactive improvements during media content items are achieved.
Patent Information
- Application Number
- CN202280095203.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-25
- Filing Date
- 2022-12-15
- Publication Date
- 2024-11-29
AI Technical Summary
The prior art is difficult to effectively convey the viewer's real-time emotion and reaction to media content, and the viewer needs to be distracted from video playback when submitting or reading comments, which lacks a convenient aggregation reaction mechanism.
By searching multiple reactions associated with media content items, grouping them based on reaction timestamps and selected graphic icons, identifying critical moments, and presenting aggregated viewer reactions within the video window, using animation and representative graphic icon representations Response intensity, allowing users to react to media content items without distraction.
It realizes real-time communication of viewer emotions and reactions during media content items playback, enhances user experience, improves the interaction between content creators and viewers, and provides an intuitive understanding of emotions and reactions at critical moments within media content items. .
Smart Images

Figure CN119053958A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims the benefit of U.S. Patent Application No. 63 / 323,895, filed on March 25, 2022, which is hereby incorporated by reference in its entirety. Technical Field
[0003] The disclosed subject matter relates to methods, systems, and media for presenting media content items with aggregated timed reactions. Background Art
[0004] Users often use websites associated with a particular service or applications associated with a particular service to view media content (e.g., stream or download media content such as music, television shows, movies, videos, etc.), connect with other users (e.g., via social networking services), perform tasks (e.g., purchase items, edit documents, receive or send messages, etc.).
[0005] Such services often include a section for viewers to react to the media content being consumed. For example, a content creator who has uploaded a video to a media sharing service may allow viewers to "like" or "dislike" the video, where the total number of "like" reactions (e.g., thumbs up) and "dislike" reactions (e.g., thumbs down) may be presented in a static area of the video window along with the video. However, such like and dislike reactions to the entire video are not expressive reactions to the video, nor are they sufficiently meaningful reactions. For example, even when the viewer may have different emotions or feelings throughout the duration of the video, the viewer can only react to the video as a whole. Therefore, there is a need to enhance the scope and frequency of electronic communication by electronically improving the communication of viewer reactions and emotions between content creators and viewers.
[0006] In addition, viewers can submit comments to include their attitudes or thoughts about the video they are consuming. In some cases, viewers can comment on a specific moment in the video by adding a timestamp of that moment in their comment. However, in order for viewers to submit comments or read comments submitted by others in the audience, viewers are often forced to scroll away from the video player or otherwise divert their attention from the video player while the video continues to play.
[0007] Therefore, it is desirable to provide new mechanisms for presenting media content items with aggregated timed reactions. Summary of the invention
[0008] According to some embodiments of the disclosed subject matter, methods, systems, and media are provided for presenting media content items having aggregated timed reactions.
[0009] According to some embodiments of the disclosed subject matter, a method for presenting a media content item with viewer reactions is provided, the method comprising: retrieving a plurality of reactions associated with the media content item, wherein each of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item at which the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icons; identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receiving a request to present the media content item from a user device; and when a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments, causing the media content item to be presented in a video window, while presenting the aggregated viewer reactions within the video window.
[0010] In some embodiments, in response to determining that the number of the plurality of reactions is greater than a threshold, the plurality of reactions associated with the media content item are retrieved from a reactions database.
[0011] In some embodiments, the method further comprises transmitting a query to a reactions database requesting a count of reactions to the media content item received since a given timestamp, wherein a plurality of reactions associated with the media content item are retrieved based on the count included in the response to the query.
[0012] In some embodiments, the method further includes, prior to retrieving the plurality of reactions associated with the media content item, determining whether the media content item qualifies for use in identifying a plurality of key moments.
[0013] In some embodiments, multiple key moments within a media content item are identified by: generating a histogram of each received reaction over time, wherein each reaction is placed within a bucket of the histogram; and detecting an expanding mound in the generated histogram as one of the multiple key moments in the media content item.
[0014] In some embodiments, a first extended ridge in the generated histogram is associated with a first time interval, and a second extended ridge in the generated histogram is associated with a second time interval, and in response to the first time interval being less than a threshold time apart from the second time interval, the first extended ridge is combined with the second extended ridge.
[0015] In some embodiments, grouping the plurality of reactions further comprises: in response to determining that a number of reactions in the subset of reactions associated with the first timestamp is less than a threshold, removing the subset of reactions from the plurality of reactions.
[0016] In some embodiments, in response to determining that a number of reactions associated with a key moment from a plurality of key moments is greater than a threshold, the key moment is identified, wherein the representative graphical icon associated with the key moment corresponds to the graphical icon most frequently selected by viewers of the media content item.
[0017] In some embodiments, the method further includes causing a reaction panel interface to be presented in the video window during presentation of the media content item, wherein the reaction panel interface includes a plurality of selectable graphical icons that each correspond to one of the plurality of reactions.
[0018] In some embodiments, in response to receiving a user selection of a graphical icon from a plurality of selectable graphical icons in the reaction panel interface, the graphical icon is presented above the playhead in a progress bar of the video window.
[0019] In some embodiments, the method further includes determining whether the graphical icon received at the first time matches a representative graphical icon associated with the moment in the first time, wherein the graphical icon presented above the playhead in the progress bar of the video window is enhanced based on the determination.
[0020] In some embodiments, the reaction panel interface has a collapsed state that includes a single graphical icon.
[0021] In some embodiments, in response to receiving a user selection of the single graphical icon, the reaction panel interface transitions from the collapsed state to the expanded state.
[0022] In some embodiments, in response to the playback position of the media content item reaching each of a plurality of key moments, a single graphical icon transitions between a first representative graphical icon and a second representative graphical icon, wherein the first representative graphical icon is associated with the first key moment and the second representative graphical icon is associated with the second key moment.
[0023] In some embodiments, the aggregate viewer reactions are presented concurrently with the media content item by presenting a graphical representation of the aggregate viewer reactions over a playhead in a progress bar of a video window.
[0024] In some embodiments, the graphical representation is an animation that includes a plurality of graphical icons corresponding to the aggregated viewer reactions, and the animation shows the plurality of graphical icons flowing from a playhead in a progress bar of the video window and into the video window.
[0025] In some embodiments, the graphical representation is an animation that indicates the aggregate viewer reactions and indicates the intensity of the aggregate viewer reactions, wherein the intensity is based on a number of reactions received at one of the plurality of key moments.
[0026] In some embodiments, in response to determining that the current playback position of the media content item does not correspond to a time window associated with one of the plurality of key moments, presentation of the graphical representation is ceased.
[0027] In some embodiments, the reaction panel interface has an expanded state that includes a plurality of selectable graphical icons that each correspond to one of a plurality of reactions, and in response to the reaction panel interface being in the expanded state, the media content item is activated to be presented in the video window simultaneously with the aggregated viewer reactions.
[0028] According to some embodiments of the disclosed subject matter, a system for presenting a media content item with viewer reactions is provided, the system comprising a hardware processor configured to: retrieve a plurality of reactions associated with the media content item, wherein each of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item at which the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; group the plurality of reactions based on the reaction timestamps and based on the selected graphical icons; identify a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receive a request from a user device to present the media content item; and when a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments, present the media content item in a video window while presenting the aggregated viewer reactions within the video window.
[0029] According to some embodiments of the disclosed subject matter, a non-transitory computer-readable medium is provided, the non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for presenting a media content item with viewer reactions, the method comprising: retrieving a plurality of reactions associated with the media content item, wherein each of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item at which the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icons; identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receiving a request to present the media content item from a user device; and presenting the media content item in a video window while presenting the aggregated viewer reactions within the video window when a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments.
[0030] According to some embodiments of the disclosed subject matter, a system for presenting a media content item with viewer reactions is provided, the system comprising: a component for retrieving a plurality of reactions associated with the media content item, wherein each of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item at which the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; a component for grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icons; a component for identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; a component for receiving a request from a user device to present the media content item; and a component for causing the media content item to be presented in a video window while presenting the aggregated viewer reactions within the video window when a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Various objects, features, and advantages of the disclosed subject matter may be more fully understood by reference to the following detailed description of the disclosed subject matter when considered in conjunction with the following drawings, in which like reference numerals identify like elements.
[0032] Figure 1 An example flow diagram of a process for identifying moments in a media content item based on aggregated viewer reactions is shown in accordance with some embodiments of the disclosed subject matter.
[0033] Figure 2 An illustrative example of a video window including a currently playing video, a timeline interface indicating a particular location in the video, and a comment interface presenting comments and / or reactions associated with the video is shown in accordance with some embodiments of the disclosed subject matter.
[0034] Figure 3 An example flow diagram of a process for generating a user interface element for providing viewer reaction when presenting a media content item is shown in accordance with some embodiments of the disclosed subject matter.
[0035] Figure 4A and Figure 4D An illustrative display screen for providing viewer reactions when presenting a media content item with a reaction interface panel currently in a collapsed state is shown in accordance with some embodiments of the disclosed subject matter.
[0036] Figure 4B and Figure 5An illustrative display screen for providing viewer reactions with a reaction interface panel currently in an expanded state while presenting a media content item is shown in accordance with some embodiments of the disclosed subject matter.
[0037] Figure 4C An illustrative display screen for providing viewer reactions with a reaction interface panel when presenting a media content item in which a user has selected a graphical icon corresponding to a reaction at a moment within the media content item is shown in accordance with some embodiments of the disclosed subject matter.
[0038] Figure 4E An illustrative display screen for providing viewer reactions with a reaction interface panel when presenting a media content item is shown, wherein viewer icons indicate relative strengths of aggregated viewer reactions, in accordance with some embodiments of the disclosed subject matter.
[0039] Figure 6 An example flow diagram of a process for reviewing and / or responding to key moments in a media content item is shown in accordance with some embodiments of the disclosed subject matter.
[0040] Figure 7 An illustrative display screen is shown for providing graphical representations of received viewer reactions throughout a media content item, wherein each graphical representation may be associated with one of the received viewer reactions, in accordance with some embodiments of the disclosed subject matter.
[0041] Fig. 8A and Figure 8B An illustrative display screen for providing a creator response to aggregated viewer reactions is shown in accordance with some embodiments of the disclosed subject matter.
[0042] Fig. 9 An example block diagram of a system that can be used to implement the mechanisms described herein for presenting media content items with viewer reactions is shown in accordance with some embodiments of the disclosed subject matter.
[0043] Fig.10 It is shown that some embodiments according to the disclosed subject matter can be Fig. 9 An example block diagram of hardware used in a server and / or user device. DETAILED DESCRIPTION
[0044] According to various embodiments of the disclosed subject matter, mechanisms (which may include methods, systems, and media) are provided for presenting media content items with aggregated timed reactions.
[0045] In general, the mechanisms described herein may present a reaction panel interface that allows viewers to provide reactions to specific portions of a media content item, and may identify key moments within the media content item based on the reactions received. Additionally, when the playback position of the media content item corresponds to a time interval associated with one of the identified key moments, the mechanisms described herein may present an audience icon or any other suitable graphical icon, reaction graphic, and / or reaction animation concurrently with the presentation of the media content item to indicate a popular reaction or sentiment at the identified key moment.
[0046] In some embodiments, the mechanisms described herein may present a reaction panel interface within a video player application or any other suitable media application, wherein the reaction panel interface may allow viewers of a media content item to select a reaction to a particular moment of the media content item. Reactions may be submitted by selecting a graphical icon (e.g., an emoticon or emoticon) from a menu of graphical icons at a particular playback position while playing the video content item. For example, these reaction panel interfaces may provide viewers with a mechanism for reacting to a particular moment within a media content item without drawing the viewer's attention away from the media content item.
[0047] In some embodiments, the reaction panel interface may have a collapsed state and an expanded state, in which a reduced number of graphic icons (such as a single graphic icon) are presented to the viewer for selection, and in which a complete set of graphic icons (such as a set of five graphic icons) are presented to the viewer for selection. In such an embodiment, in response to receiving a specific user input (e.g., a long press on the touch-sensitive display at an area corresponding to the collapsed reaction panel interface), the reaction panel interface may be converted from the collapsed state to the expanded state. Alternatively, in response to receiving another specific user input (e.g., a short press on the touch-sensitive display at an area corresponding to the collapsed reaction panel interface), the reaction panel interface may cause the graphic icon displayed on the collapsed reaction panel interface to be submitted as a reaction to a specific moment in the media content item. It should be noted that in some embodiments, in response to reaching a key moment within the media content item, the graphic icon displayed on the collapsed reaction panel interface may be modified to a representative graphic icon. It should also be noted that in some embodiments, the synchronized presentation of the aggregated timed reactions at the key moment may be activated in the video window based on the state of the reaction panel interface (e.g., feature activation when the reaction panel is expanded).
[0048] In some embodiments, a graphical icon selected by a viewer from a reaction panel interface may be presented within a video window currently presenting a media content item. For example, an animation including a graphical icon selected by a viewer from a reaction panel interface may be presented above the playhead of a progress bar in a video window. The animation or any other suitable graphic may represent an incoming stream of reactions and may, for example, provide viewers of the media content item with an understanding of how other viewers feel about a moment within the media content item.
[0049] In some embodiments, the mechanism described herein can use the received reaction submitted using the reaction panel interface to identify the key moment in the media content item.For example, the mechanism can determine the reaction subset from the retrieved reaction occurring in the same part of the media content item.In another example, the mechanism can determine that the number of reactions at a specific time point is higher than a threshold value, and these reactions can be grouped into key moments.In another example, the mechanism can generate one or more histograms of the received reaction grouped into straight bars (bin) based on the time of receiving the reaction and the type of the received reaction (for example, a "heart-shaped" emoticon), and can detect the existence of the key moment in the media content item based on the analysis of the features in the histogram.Continuing this example, the time interval corresponding to the specific feature in the histogram can be associated with the key moment of identification, for example, 500 viewers like the moment between 1:25 and 1:30 in the media content item.Each key moment can be associated with a representative graphic icon.For example, in the above example, the "heart-shaped" emoticon can be associated with the specific key moment occurring between 1:25 and 1:30 in the media content item because it represents the popular mood at this moment in the media content item.
[0050] In some embodiments, a representative graphic icon or any other suitable graphic representing the popular emotions of the key moment in the media content item can be synchronously presented during the presentation of the media content item. For example, during the presentation of the media content item, when the time interval of the current playback position matches the key moment, a representative graphic icon or any other suitable graphic can be presented above the playhead of the progress bar in the video to indicate the popular emotions of the received reaction from this key moment in the media content item. In another example, a key moment and its corresponding representative graphic icon can be presented along the timeline interface of the media content item. For example, this can provide the viewer of the media content item with an understanding of how other viewers feel about this moment in the media content item.
[0051] In some embodiments, different representative graphical icons or graphics may be presented based on the strength or magnitude of the aggregated viewer reactions at that moment. For example, in response to receiving a relatively larger number of reactions at a key moment, the mechanism may select a representative graphical icon that indicates the relative strength of the reactions (e.g., a fountain animation of multiple "heart" icons flowing from the playhead in the progress bar). In another example, in response to receiving a relatively larger number of reactions at a key moment, the mechanism may select an animation of a graphical icon in which the graphical icon appears in proportion to the number of reactions received.
[0052] In some embodiments, the mechanisms described herein may also provide features for content creators. For example, in some embodiments, an interface may be provided to a content creator that illustrates identified key moments and associated key moment information for one or more media content items uploaded by the content creator. The key moment information may include, for example, thumbnail graphics extracted from relevant portions of the media content, time intervals corresponding to the key moments, one or more reactions received at the key moments (e.g., the most popular reactions, the top three reactions, etc.), one or more graphic icons selected from a reaction panel interface at the key moments, and the like. For example, this may provide the content creator with an understanding of how the audience feels about different moments within the media content items and / or provide an understanding of which moments within the media content items provide the most reaction or engagement from the audience.
[0053] In some embodiments, the interface presented to the content creator may provide the content creator with an opportunity to respond to aggregated timed reactions at identified key moments within the media content item. For example, the content creator may select key moments to provide responses to viewer reactions to key moments. Such responses from the content creator may be presented to viewers of the media content item. For example, the response may be incorporated adjacent to a representative graphical icon in a comment panel, a live chat interface, or any other suitable portion of a video player application. For example, this may provide an interactive mechanism between a content creator and a viewer.
[0054] Combination Figures 1 to 10 These and other features are further described for presenting media content items with aggregated timed reactions.
[0055] Go to Figure 1 , an example flow chart of a process 100 for identifying moments in a media content item based on aggregated viewer reactions is provided in accordance with some embodiments of the disclosed subject matter. In some embodiments, the blocks of process 100 may be performed by any suitable device. For example, in some embodiments, the blocks of process 100 may be performed by a server, such as a server that hosts one or more media content items and streams the media content items to a user device.
[0056] It should be noted that process 100 can be performed at any appropriate time. For example, in some embodiments, process 100 can be performed by a server, which hosts one or more media content items and in response to receiving a request for a playback media content item from a user, media content item streaming is transmitted to a user device. In another example, in some embodiments, process 100 can be performed periodically in conjunction with any suitable indexing service, which indexes and / or compiles statistics (e.g., viewing counts, likes or any other suitable recognition, reactions, new and / or revised comments, etc.) associated with media content items. In yet another example, in some embodiments, when process 100 (or any other suitable mechanism) detects a new reaction associated with a given media content item, process 100 can be performed. In a further example, in some embodiments, process 100 can be performed in response to a request to transmit to a server, which request requests a count of any video that has received participation since a given timestamp.
[0057] In some embodiments, process 100 may begin at 102 by retrieving a reaction associated with a media content item using any suitable technique or combination of techniques. Figures 3 to 5 As discussed, a reaction may be an expression from a viewer that indicates how the viewer feels at a particular portion of a media content item. For example, in some embodiments, a reaction may be received when a viewer selects a graphic icon (e.g., an emoticon or emoji) from a menu of graphic icons at a particular timestamp while playing a video content item.
[0058] It should be noted that although the embodiments described herein generally relate to determining reactions received using a reaction panel interface, this is merely illustrative and reactions may be retrieved from any suitable source. For example, a server device may obtain comment data associated with a media content item and extract reactions from each comment in the comment data. In a more specific example, a comment received from a user may include textual content, graphical content, a time reference, etc., wherein reactions may be extracted from textual content (e.g., a message includes the term "favorite"), from graphical content (e.g., a message includes a "heart" emoticon), etc.
[0059] In some embodiments, when a user device (e.g., such as a combination of Fig. 9 When a user of the user device 904 described above submits a reaction associated with a media content item (e.g., a video that has been uploaded to a media sharing service), a server device (e.g., such as a server device) may be used to generate a response. Fig. 9 The reactions are received at a server device 902 as described above. The reactions and other timed participation from viewers can be processed and stored. In such examples, the process 100 can access, request and / or retrieve the reactions from the server device.
[0060] In a more specific example, in response to a request to transmit a media content identifier that includes a media content item or a portion of a media content item, the server device may access a reaction and associated reaction information from a reaction database. The reaction information from the reaction database may include: a reaction identifier that identifies the reaction; a reaction timestamp that identifies the timestamp at which the reaction was received from the viewer; a frame number that identifies the frame at which the reaction was received from the viewer; and / or any other suitable reference to a point in time within the media content item when the reaction was received from the viewer; a user identifier that identifies a user account associated with a user or user group that provided the reaction; a creation timestamp that indicates the time when the reaction was created; a media content identifier that identifies the media content item or a portion of the media content item associated with the reaction; and the like. As another example, the reaction may be included in metadata associated with the media content item. In such examples, the process 100 may simultaneously access, request, and / or retrieve reactions associated with the media content item and metadata associated with the media content item (e.g., the title of the media content item, the description of the media content item, the content creator of the media content item, etc.). As described above, in some embodiments, process 100 may be performed in response to determining from a reaction database that the number of reactions received to a video content item is greater than a threshold (e.g., more than ten total reactions, more than ten reactions in the past 24 hours, an increase in received reactions exceeding a particular percentage, etc.).
[0061] It should be noted that in some embodiments, prior to performing process 100 or after determining reaction information from the reaction database at 102, the server may determine whether the video content item is too risky to qualify for use in identifying key moments in the media content item. For example, in response to determining that a given video content item has received more than a threshold number of reactions within a particular time period, process 100 may determine a risk rating associated with the video content item. In a more specific example, the video content item may be input into one or more risk classifiers that determine (i) whether the video content item is present on a block list, (ii) whether the video content item is associated with a channel identifier or user identifier present on the block list, (iii) whether the video content item is associated with a particular content type (e.g., news content), (iv) whether the video content item is associated with a subject or other entity that is considered sensitive or offensive (e.g., violent content, offensive language, hate speech, adult content, and / or any other suitable type of offensive content), etc. Continuing with this example, in response to determining that one or more risk classifiers have deemed the video content item to have a risk rating greater than a particular threshold (e.g., a high-risk video content item based on the video content item being associated with a news content type), process 100 may end without identifying key moments for the video content item associated with the high risk rating. Alternatively, process 100 may determine whether the video content item qualifies for identifying key moments within the video content item based on viewer reactions received during presentation of the video content item.
[0062] In some embodiments, at 104, process 100 may group, sort, and / or aggregate reactions according to reaction timestamps or any other suitable time reference that connects reactions received from viewers to the portion of the media content item being presented when the reactions are received. For example, in some embodiments, during presentation of the media content item, a viewer reaction may be received when the media content item is at a time position of 0:25 (twenty-five seconds) from the start position of the media content item, and the reaction may be a "heart" emoticon or a graphic icon selected by the viewer from a menu of graphic icons, as described below in conjunction with Figure 2 and FIG. 4A to FIG. 5 Continuing with this example, viewer reactions received during presentation of a media content item may be grouped (e.g., the number of "heart" emoticons received at or around 0:25 seconds from the start of the media content item and the number of "smiley face" emoticons received at or around 0:25 seconds from the start of the media content item). In another example, in some embodiments, process 100 may group received reactions using frame numbers or any other time reference. In some embodiments, process 100 may create a group of user reactions for reactions occurring at the same timestamp and / or frame number.
[0063] In some embodiments, process 100 may determine that a certain number of reactions have been received at a certain timestamp and / or time window (e.g., a duration having a start timestamp and an end timestamp, a duration having a start frame number and an end frame number) at 106. For example, process 100 may determine that greater than a threshold number of reactions (e.g., 10 reactions) have been received at a certain time position within the media content item.
[0064] Should be noted that the threshold value number can be any suitable value.For example, based on the time position or time window of the media content item, the reaction received that exceeds the threshold value number is associated, and the server can continue to detect whether the key moment has occurred in the media content item.In another example, the server can determine the average number of reactions received for the media content item uploaded by a specific content creator, and can be associated with the average number of reactions received for the media content item uploaded by a specific content creator based on the time position or time window of the media content item, and continue to detect whether the key moment has occurred in the media content item.In another example, in response to determining that at least 10 reactions are received at the given time position or time window of the media content item, and in response to determining that the number of reactions received at the given time position is greater than 1% of the total number of reactions received to the media content item, the server can continue to detect whether the key moment has occurred in the media content item.In a further example, the server can change the threshold value based on network traffic, time of day and / or any other suitable standard.
[0065] In some embodiments, in response to determining that a specific time position in a media content item contains a reaction greater than a threshold value, process 100 can assign a time window as a key moment in the media content item. It should be noted that a key moment can be associated with a single time position in the media content item, a time window in the media content item, a single frame of the media content item, a frame subset of the media content item, a chapter or section of the media content item, etc. In some embodiments, in response to determining that a plurality of different time windows contain a reaction greater than a reaction threshold value in the time window, process 100 can identify a plurality of key moments in the media content item. For example, in some embodiments, the length of the media content item can be five minutes, and process 100 can identify five such key moments in the media content item.
[0066] As a supplement or alternative to identifying the key moment in the media content item by determining that the number of viewer reactions in the media content item is greater than the time position of the threshold, the key moment can be identified by analyzing the distribution of viewer reactions on the length of the media content item. For example, when generating the distribution of viewer reactions received during the presentation of the media content item on the playback position of the media content item, process 100 can extract pattern features from the distribution, and identify the key moment based on the extracted pattern features. In a more specific example, process 100 can determine whether there is a statistically significant deviation from a normal distribution, wherein a significantly significant deviation can include the sharp increase of the number of reactions received in a short duration. In another more specific example, process 100 can determine whether there is a statistically significant deviation from a normal distribution, wherein a significantly significant deviation can include the increase of the number of reactions received in a first duration, and then the number of reactions received in a second duration significantly reduces. It should be noted that by analyzing the distribution of viewer reactions and / or participation, different numbers of key moments can be identified, rather than determining the key moment based on a threshold.
[0067] In some embodiments, a water filling algorithm may be used to identify key moments in a media content item to determine how to group reactions or engagements together. For example, process 100 may use a water filling algorithm to generate a histogram for the received reactions, wherein the histogram divides the received reactions into a set of buckets with a specific bucket size. In a more specific example, where the minimum bucket size is 1 second, a histogram may be generated for a media content item, wherein a timestamp associated with each received reaction may be used to place the received reaction into one of the buckets. In another more specific example, the generated histogram may be a plurality of histograms (e.g., a plurality of overlapping histograms), wherein each histogram may represent the distribution of the selected graphic icons received during the presentation of the media content item (e.g., a heart emoticon histogram, a crying emoticon histogram, and a histogram of all received reactions).
[0068] A water injection algorithm or any other suitable method for generating a histogram of reactions received by a media content item may detect the presence of one or more extended bumps within the histogram, wherein a local minimum may be reached on either side of the extended bump. Continuing with this example, an extended bump in the histogram having more than a certain number of received reactions may be considered a key moment in the media content item, wherein the time interval corresponding to the extended bump may be associated with the key moment (e.g., time interval = [35, 40]). Alternatively, a certain number of bumps within the histogram may be considered a key moment in the media content item (e.g., the three largest bumps).
[0069] It should be noted that in embodiments where two ridges in the above histogram overlap or are within a certain time threshold (e.g., separated by a 1 second interval), the two ridges may be combined to create a single continuous ridge. Alternatively, two different moments may be defined when two ridges intersect leaving a depression between them.
[0070] Thus, the histogram can be used to determine time intervals based on received reactions associated with the media content item. For example, process 100 can analyze the histogram to determine that the media content item contains three key moments with time intervals [23, 30], [043, 46], and [84, 86] in the interval [0, 100].
[0071] It should be noted that in some embodiments, a minimum threshold may be applied to the reactions received. For example, this may filter out baseline noise. In a more specific example, due to the noise in the reaction data, a minimum number of reactions within a given second may be defined (e.g., at least two reactions within a given second of the video), wherein the times in the histogram having less than the minimum number of reactions within a given second may be zeroed or otherwise removed from the histogram. In another more specific example, a minimum percentage of the total number of reactions received may be defined (e.g., 1% of the total number of reactions received), wherein buckets having less than the minimum percentage of the total number of reactions received may be zeroed or otherwise removed from the histogram.
[0072] It should also be noted that, in conjunction with the above-mentioned histogram, process 100 can set a minimum number of reactions or engagements per bucket (minimum count per bucket) to continue to identify key moments in media content items. In some embodiments, process 100 can also set a minimum number of total reactions or engagements within a media content item (minimum total engagement count) to continue to identify key moments in a media content item.
[0073] In some embodiments, a group of received reactions in an identified key moment may be associated with the same graphical icon (e.g., a heart emoticon, a smiling face graphical icon, etc.). For example, at a time position of 1 minute 25 seconds in a media content item, the server receives 30 viewer reactions, each of which is a heart emoticon. In response, process 100 may associate the key moment with the heart emoticon as a representative graphical icon.
[0074] Alternatively, in some embodiments, a set of received reactions in an identified key moment may be associated with multiple graphical icons (e.g., a mix of reactions associated with a heart emoji and reactions associated with a smiley face graphical icon). Continuing with this example where multiple graphical icons are associated with a key moment, process 100 may select the most common graphical icon as the key moment graphical icon to represent the key moment. For example, in some embodiments, process 100 may determine that 3,300 reactions have been received within a 5 second (five second) time window of a media content item. Continuing with this example, process 100 may determine that approximately 3,000 of the received reactions contain a “heart” emoji as a graphical icon, and approximately 300 of the received reactions contain a “surprised face” emoji as a graphical icon. In this example, process 100 may identify the key moment as a five second time window, and may associate the “heart” emoji with the key moment as a representative graphical icon for the key moment.
[0075] Additionally or alternatively, process 100 may associate all reaction icons that appear within a time window of the key moment with the key moment.
[0076] In some embodiments, in response to identifying key moments within a media content item based on aggregated viewer reactions and / or viewer engagement, the server may associate the media content item with each identified key moment and one or more associated graphical icons received at the identified key moment. For example, in response to identifying key moments within a media content item based on aggregated viewer reactions and / or viewer engagement, the server may generate an index, wherein a row of the index includes a media identifier corresponding to the media content item, a creator identifier corresponding to a user account of a content creator who uploaded the media content item, a moment identifier corresponding to the identified key moment, a time reference associated with the identified key moment, a representative graphical icon associated with the identified key moment (e.g., the most popular emoji selected by viewers at the time reference associated with the identified key moment), a total number of reactions received at the time reference associated with the identified key moment (e.g., 3,000 “heart” emojis), a total number of each type of reaction received at the time reference associated with the identified key moment (e.g., 3,000 “heart” emojis, 10 “smiley face” emojis, and 5 “thumbs-up” emojis), etc.
[0077] In response to receiving a request to view a media content item from a user device at 108 (e.g., a content creator who is accessing a dashboard interface related to a media content item, a viewer who has requested a server to begin playing a media content item, etc.), process 100 may cause the identified key moments to be presented in conjunction with the media content item. Specifically, the identified key moments and / or representative graphical icons of the key moments may be retrieved from the above-mentioned index and presented at a specific time window of the key moments during the presentation of the media content item. For example, Figure 2 As shown, representative graphic icons or other reaction information may be presented in a comment interface that is displayed simultaneously with the presentation of the media content item. In another example, representative graphic icons or other selected reactions may be presented in a timeline interface that is displayed simultaneously with the presentation of the media content item to highlight the association of the received reactions with the specific time window in which the reactions were received.
[0078] Figure 2 An illustrative example 200 of a video window including a currently playing video, a timeline interface indicating a particular location in the video, and a comment interface presenting comments and / or reactions associated with the video is shown in accordance with some embodiments of the disclosed subject matter.
[0079] It should be noted that while the embodiments described herein typically present aggregated timed reactions during the presentation of a pre-recorded video that has been uploaded to a media sharing platform, this is merely illustrative. Aggregated timed reactions or other aggregated timed engagements may be presented simultaneously with any suitable media content item (such as live streamed video content, audio content, textual content, short clips extracted from pre-recorded video, short form video, gaming content, etc.).
[0080] like Figure 2 As shown, display 200 may include video playback area 210, timed comment pane 220, comments 222 and 224 with timed references, and identified moments 226. In some embodiments, timed comment pane 220 may update the display of timed comments and moments during the playback of the media content item displayed in video playback area 210. In some embodiments, timed comment pane 220 may include the moments identified at 106 in chronological order, and timed comments. As shown, moment 226 may include any suitable text and / or graphics. For example, as shown, moment 226 may include a representative graphic icon indicating a reaction selected by a viewer of the video content, a timestamp corresponding to the moment in the video (e.g., time position 1:05 in the video), and an indication of the size of the reaction (e.g., 2,000 viewers provided reactions through representative graphic icons).
[0081] In another example, if Figure 5As shown, when the media content item reaches the playback position associated with the identified key moment, the moment 226 can be presented to the user by presenting a representative graphic icon, a reaction graphic, or a reaction animation in the timeline interface. For example, a representative graphic icon (e.g., a "heart" emoticon) associated with the identified key moment can be presented above the playhead or any other suitable indicator of the current playback position in the timeline interface. In another example, a reaction animation can be presented above the playhead or any other suitable indicator of the current playback position in the timeline interface, and the reaction animation indicates the graphic icon selected by the viewer at the identified key moment and indicates the intensity of the reaction. In yet another example, a reaction graphic can be presented above the playhead or any other suitable indicator of the current playback position in the timeline interface, and the reaction graphic indicates the graphic icon selected by the viewer at the identified key moment and indicates the intensity of the reaction. Continuing with the example, the reaction graphic can be audience icons, such as: a first audience icon that includes a single iteration of the representative graphic icon to indicate that a small number of viewers provided the reaction at that moment (e.g., a single heart emoji to indicate that fewer than 10 viewers provided the reaction at that time position within the video); a second audience icon that includes three iterations of the representative graphic icon to indicate that a larger number of viewers provided the reaction at that moment (e.g., a graphic icon with three heart emojis to indicate that 10 to 100 viewers provided the reaction at that time position within the video); and a third audience icon that includes five iterations of the representative graphic icon to indicate that an even larger number of viewers provided the reaction at that moment (e.g., a graphic icon with five heart emojis to indicate that more than 100 viewers provided the reaction at that time position within the video).
[0082] In yet another example, in some embodiments, one or more key moments may be presented in an overlay interface with the media content item (e.g., a reaction overlay interface presented below the video, a reaction overlay interface positioned within the top of the video, a reaction teaser interface including a single selected reaction positioned adjacent to the video on a video watch page, etc.). Continuing with this example, in some embodiments, the key moments may be presented with any suitable graphics to indicate the amount of reactions in the key moments. For example, in some embodiments, a first graphic including a single iteration of a representative graphic icon may be used to indicate that a small number of viewers reacted at the moment (e.g., a single heart emoji to indicate that fewer than 300 viewers provided a reaction at that time position within the video). Continuing with the example, in some embodiments, a second graphic having three iterations of a representative graphical icon and a third graphic having five iterations of reactions may be used to indicate that an increasing number of viewers have reacted at that moment (e.g., a graphical icon having three heart emojis indicating that approximately 500 viewers provided the reaction at that time position within the video, and a graphical icon having five heart emojis indicating that approximately 1,000 viewers provided the reaction at that time position within the video, respectively).
[0083] It should be noted that although the embodiments described herein generally describe the designation of representative graphical icons for key moments, this is merely illustrative, and multiple graphical icons may be associated with identified key moments and incorporated into the display. For example, in some embodiments, process 100 may present an animation representing reactions received at a key moment. As a specific example, a key moment may include a large number of reactions received using a "heart" icon (e.g., 500 reactions using the "heart" icon) and a smaller number of reactions using a "smiley face" icon (e.g., 10 reactions using the "smiley face" icon). In this example, process 100 may use a cascading animation with a majority of "heart" graphics and a smaller number of "smiley face" graphics proportional to the number of each corresponding reaction received at the key moment.
[0084] When the playhead reaches a play position corresponding to the identified key moment, the representative graphic icon, reaction graphic and / or reaction animation presented during the presentation of the media content item can, for example, provide the popular reaction at the moment of the identification to the viewer of the media content item, without scrolling away from the media content item to view the engagement counter (e.g., a counter showing the total number of likes). When the playhead reaches a play position corresponding to the identified key moment, the representative graphic icon, reaction graphic and / or reaction animation presented during the presentation of the media content item can also, for example, provide the viewer of the media content item with general viewer reactions at the portion of the media content item with a large amount of engagement.
[0085] In some embodiments, at 112, process 100 may return to 102 and another iteration of process 100 may be performed. As described above, in response to detecting that the reaction database has been refreshed with new and / or modified reactions, process 100 may be performed. Continuing with this example, process 100 may return to 102 to determine whether additional key moments exist within the video content item based on the new and / or modified reactions. In another example, in response to detecting that a plurality of new reactions have been received during presentation of the media content item in a subsequent time window (e.g., the past 24 hours), process 100 may be repeated.
[0086] Go to Figure 3 , according to some embodiments of the disclosed subject matter, an example flow diagram of a process 300 for generating a reaction panel interface for providing viewer reactions when presenting a media content item is provided.
[0087] In some embodiments, process 300 may be performed on a server (such as server 902) and / or a user device (such as user device 906), as described below in conjunction with Fig. 9 For example, the blocks of process 300 may be performed by a user device (e.g., a mobile phone, a tablet computer, a laptop computer, a desktop computer, a wearable computer, a streaming media device, a smart television, a game console, a vehicle entertainment system, and / or any other suitable user device) that streams video content from a server. Note that in some embodiments, the blocks of process 300 may be performed by an application (e.g., an application associated with a particular video content service and / or any other suitable application) executed on a user device for streaming and presenting video content.
[0088] In some embodiments, process 300 may be initiated in response to a user interacting with a web page and / or application service to view media content. For example, in some embodiments, process 300 may begin when a user launches a video sharing application and navigates to view a particular video (e.g., a live video, a replay of a previously live video, a previously recorded video, a video on demand, etc.). As described above, it should be noted that while the embodiments described herein generally relate to providing timed reactions during the presentation of a pre-recorded video that has been uploaded to a media sharing platform, this is merely illustrative. Timed reactions or other timed engagements may be provided in conjunction with any suitable media content item (such as live streamed video content, audio content, textual content, short clips extracted from a pre-recorded video, a replay of previously live streamed video content, short form video content, game content, etc.).
[0089] In some embodiments, before allowing a user to interact with a reaction panel interface to provide viewer reactions during presentation of a media content item, process 300 may determine whether the content creator of the media content item has provided appropriate permissions to render the reaction panel interface or otherwise provide viewer reactions during presentation of the media content item. For example, in the case where the media content item is a live streamed media content item, the content creator of the live streamed media content item may provide the following configuration instructions: a reaction panel interface may be presented to viewers of the live streamed media content item to provide additional reactions during live streaming of the media content item, but the reaction panel interface may not be presented during replay of the live streamed media content item. Continuing with this example, a reaction panel interface may be activated when presenting the live streamed media content item, and in response to rewinding or replaying a previous portion of the live streamed media content item, the reaction panel interface may be deactivated or otherwise disabled to provide user-selected reactions. Although the reaction panel interface has been disabled and / or removed from the display screen, the reaction panel interface may continue to be presented as described above. Figure 4D The fountain animation shown or any other suitable mechanism for providing aggregated viewer reactions during presentation of a media content item. For example, this can provide viewers with an indication of aggregated viewer reactions at a particular moment during a live streaming media content item.
[0090] In some embodiments, before allowing a user to interact with a reaction panel interface to provide a viewer reaction during presentation of a media content item, process 300 may determine whether a configuration setting is associated with the reaction panel interface or whether the user has access to the reaction panel interface. For example, a configuration setting may be provided that disables or otherwise prohibits a viewer's choice of presentation of a reaction panel interface, e.g., a user has provided a configuration setting that indicates that the user is not interested in using the reaction panel interface to provide a reaction to a moment in a media content item. In another example, a content creator of a media content item may provide a configuration setting in which certain users may be provided with an opportunity to use the reaction panel interface to provide a reaction to a moment in a media content item. In a more specific example, a configuration setting from a content creator may provide a reaction panel interface to a user with a user account that subscribes to a channel associated with the content creator, a user with a user account that has account privileges (whether paid or unpaid), and the like. Continuing with the example, a reaction panel interface having a first set of selectable graphical icons (e.g., a set of general icons) may be presented to users who do not have specific account privileges, and a reaction panel interface having a second set of selectable graphical icons (e.g., a set of creator-selected icons, a set of members-only emoticon icons, etc.) may be presented to users who have specific account privileges.
[0091] In some embodiments, before allowing the user to interact with the reaction panel interface to provide viewer reactions during the presentation of the media content item, process 300 may determine at 302 whether the user has previously interacted with the reaction panel interface. For example, in some embodiments, process 300 may use a user account, a user name, a user ID, and / or any other identifying feature to determine that the user has not previously interacted with the reaction panel interface. In a more specific example, in some embodiments, process 300 may query a log service to determine whether a reaction panel interface for providing viewer reactions during the presentation of the media content item has been previously rendered in a video sharing application executed on a user device. In another more specific example, in some embodiments, an indication may be stored in association with the user account indicating whether this is the first instance that a reaction panel interface has been rendered in a video sharing application executed on a user device.
[0092] In response to determining at 302 that the user has not previously interacted with the reaction panel interface, process 300 may display a tooltip interface that instructs the user about features of the reaction panel interface. For example, the tooltip interface may provide a series of images that illustrate multiple states of the reaction panel interface, such as a collapsed state with a default graphical icon (e.g., a single “heart” emoji) for providing a reaction to the current playback position of the media content item; a collapsed state in which a single graphical icon is presented and may be modified during presentation of the media content item to a representative graphical icon to indicate aggregated viewer reactions at the current playback position of the media content item (e.g., changing a single “heart” emoji to a single “crying” emoji to indicate a popular viewer reaction at that moment in the video content item); and an expanded state in which the user may select from a menu of graphical icons to provide a reaction to the current playback position of the media content item. In another example, the tooltip interface may provide a series of images illustrating user interactions with a graphical icon in a reaction panel interface, e.g., selecting the graphical icon may cause a reaction to be presented in the media content item at the current playback position of the media content item, selecting the graphical icon multiple times within a particular time period may cause an animated reaction to be presented in the media content item at the current playback position of the media content item, etc. In yet another example, the tooltip interface may provide a series of images illustrating different representative graphical icons presented on a playhead or timeline interface of a video window, wherein the different representative graphical icons may indicate aggregated viewer reactions at the current playback position of the media content item and / or may indicate the relative strength of the aggregated viewer reactions (e.g., a relatively large number of received reactions at that moment in the media content item).
[0093] It should be noted that in some embodiments, the tool tip interface may allow the user to select a portion of the reaction panel interface to receive feature information related to the selected portion of the reaction panel interface. It should also be noted that in some embodiments, the tool tip interface may be an animated tutorial that guides the user through the process of Figure 3 The process 300 is described in FIG. 4A to FIG. 5 The user interface shows the features of the reaction panel interface.
[0094] In some embodiments, in response to receiving a user selection indicating an interest in providing a reaction during presentation of a media content item, a tooltip interface may be presented. For example, in response to viewing a media content item in a video sharing application and determining that the video sharing application has not previously rendered a reaction panel interface, the video sharing application may present a message instructing the user to provide specific user input to present the tooltip interface and / or the reaction panel interface (e.g., a “Long press the like button to try more reactions” message). In response to receiving the specific user input, the tooltip interface may be presented to the user within the video sharing application.
[0095] In some embodiments, process 300 may continue at 306 by displaying a reaction panel interface within the video sharing application. Figure 4A As shown, the reaction panel interface may be initially displayed in a collapsed state with a default graphical icon (e.g., a single “heart” emoji) for providing reactions to the current playback position of the media content item. In another example, the reaction panel interface may be initially displayed in a collapsed state presenting a single graphical icon, wherein the single graphical icon may be modified during presentation of the media content item to a representative graphical icon to indicate aggregated viewer reactions at the current playback position of the media content item (e.g., changing a single “heart” emoji to a single “crying” emoji to indicate a popular viewer reaction at that moment in the video content item). In yet another example, as Figure 4B and Figure 4C As shown, the reaction panel interface can be initially displayed in an expanded state in which a user can select from a menu of graphical icons to provide a reaction to a current playback position of a media content item.
[0096] In a more specific example, Figure 4A An illustrative display screen 400 for providing viewer reactions when presenting a media content item is shown in accordance with some embodiments of the disclosed subject matter. As shown, display screen 400 may include a video area 410, a comment panel 420, and a reaction panel interface 430 that is currently in a collapsed state. Figure 5 As shown, display screen 500 may also include information such as a video title, a channel name, a view count, a like count, a dislike count, a video description, video chapter links, and / or any other suitable information.
[0097] In some embodiments, the video area 410 may include any suitable display elements, such as a video playback area 411, a progress bar 412, a playhead 413, a timestamp 414, and one or more media controls 415. The video playback area 411 may present any suitable video content 411, such as video-on-demand content, user-generated video content, live-streamed video content, replays of live-streamed video content, short clips extracted from pre-recorded video content, short-form video content, etc. Figure 4A As shown, a progress bar 412 can provide a timeline interface indicating how much of the video has been watched, and a playhead 413 can be represented by a graphic line in the timeline interface that indicates the current playback position or current frame of the video being played. In some embodiments, the video area 410 can present a timestamp 414 to indicate a corresponding time reference at the current playback position or current frame of the video being played, where the time reference can be represented as a time in the total length of the video.
[0098] In some embodiments, the comments panel 420 may include any suitable controls for sorting user-submitted comments associated with a video content item. Figure 4A As shown, the comment panel 420 can be sorted by "top comments". Alternatively, in some embodiments, the comment panel 420 can sort the comments submitted by the user by any other suitable method (such as the most recent comments, timed comments, fixed comments, etc.).
[0099] In some embodiments, reaction panel interface 430 may provide a user with an interface for selecting a reaction to the current playback position of a media content item. Figure 4A As shown, reaction panel interface 430 can be initially displayed in a collapsed state with a default graphical icon (eg, a single “heart” emoticon) for providing a reaction to a current playback position of a media content item.
[0100] It should be noted that the reaction panel interface 430 may be presented at any suitable location within the display screen 400. For example, Figure 4AAs shown, reaction panel interface 430 may be positioned as an overlay within comment panel 420. More specifically, reaction panel interface 430 may be positioned in the lower right portion of comment panel 420 and may be displayed above comments and other comment-related information displayed within comment panel 420. In another example, such as when the user device is a mobile device presenting a media content item in landscape mode, reaction panel interface 430 may be overlaid onto the media content item, wherein reaction panel interface 430 may be switched between an active state, in which reaction panel interface 430 may be overlaid onto the right portion of the media content item, and an inactive state, in which reaction panel interface 430 may be overlaid onto the right portion of the media content item. In yet another example, such as when the media content item is a live streamed video with a live chat interface, reaction panel interface 430 may be positioned in a portion of the live chat interface.
[0101] It should also be noted that reaction panel interface 430 may include any suitable graphics. For example, in some embodiments, the graphic icon presented in reaction panel interface 430 may be a default graphic icon selected from a menu of selectable graphic icons. For example, Figure 4A As shown, the “heart” emoticon is selected from a plurality of graphic icons as a default graphic icon for presentation on the reaction panel interface 430 .
[0102] In some embodiments, the default graphical icons in the reaction panel interface 430 may be modified to representative graphical icons during the presentation of the media content item to indicate the aggregated viewer reactions at the current playback position of the media content item. For example, the "heart" emoticon in the reaction panel interface 430 may be converted to present a single "crying" emoticon to indicate the popular viewer reactions at that moment in the video content item. In a more specific example, the single graphical icon presented in the reaction panel interface may be animated to transition between representative graphical icons based on the aggregated viewer reactions while the media content item is being played. It should be noted that in the case where the current playback position does not correspond to the identified key moment of the media content item, the default graphical icon may not be presented in the reaction panel interface 430, and the selection of the reaction panel interface 430 may be converted to an expanded state to select from a menu of graphical icons to provide a reaction to the current playback position of the media content item.
[0103] In some embodiments, the reaction panel interface 430 in the collapsed state can present a fountain animation of the viewer reaction when receiving the viewer reaction. For example, in the case where the video sharing application is a live video chat application, the selected graphic icon representing the user reaction can be presented with a fountain animation, wherein the received user reaction flows upward and out of the reaction panel interface 430. In a more specific example, as Figure 4DAs shown, in response to receiving a “smiley face” icon representing a first received reaction, followed by receiving a “heart” icon representing a second received reaction, and another “heart” icon representing a third received reaction to a moment in the video, a fountain animation may be presented in conjunction with reaction panel interface 430, wherein a “smiley face” icon 432 flows out of reaction panel interface 430, followed in temporal and vertical order by a “heart” icon 434 and another “heart” icon 436. Continuing with this example, the icons corresponding to the received reactions presented in the fountain animation may fade when the icons reach a portion of display screen 400 (e.g., video area 410).
[0104] In some embodiments, a default graphical icon may be associated with a corresponding reaction, and in response to receiving a user selection of the default graphical icon on reaction panel interface 430, the corresponding reaction may be associated with the current playback position of the media content item (e.g., a "like" reaction made by the user at t=1:25 of the video content item). Alternatively, in some embodiments, in response to receiving a user selection of the default graphical icon, reaction panel interface 430 may be displayed from Figure 4A The folded state shown transitions to Figure 4B The expanded state 440 is shown.
[0105] Alternatively, in some embodiments, reaction panel interface 430 may be associated with multiple actions based on received user input. For example, where the user device is a mobile device with a touch-sensitive display, user input deemed as a short press of a default graphical icon of reaction panel interface 430 may cause a corresponding reaction (e.g., a "like" reaction) to be provided in conjunction with the current playback position of the media content item, and user input deemed as a long press of the default graphical icon of reaction panel interface 430 may cause reaction panel interface 430 to be changed from Figure 4A The folded state 430 shown is converted to Figure 4B The expanded state 440 is shown.
[0106] Return to reference Figure 3 In response to receiving a suitable user input (e.g., a tap input on a collapsed reaction panel interface, a long press on a collapsed reaction panel interface, etc.), process 300 may expand the reaction panel interface at 308. For example, where the reaction panel interface is initially displayed in a collapsed state, and in response to receiving a suitable user input, process 300 may expand the reaction panel interface to present a plurality of graphical icons that a user may select to provide a reaction to a current playback position of a media content item.
[0107] like Figure 4BAs shown, the reaction panel interface 430 can be vertically expanded into a reaction panel interface 440, and the reaction panel interface 440 includes a "heart" icon 441, an "applause" icon 442, a "crying" icon 443, a "unicorn" icon 444, and a "sun" icon 445, wherein each of the selectable icons can correspond to a specific reaction to the content presented at the current playback position of the media content item. Examples of reactions to moments in the media content item may include: like, support, and other positive feelings; humorous feelings; encouragement, agreement, cheers, approval, celebration, and other support feelings; surprise, amazement, discovery, breakthrough, new information, and other learning / surprise feelings; and / or sympathy, concern, sadness, and other empathy feelings. For example, the "heart" icon 441 may correspond to a like or support reaction made by a user who is watching the video content, and the "applause" icon 442 may correspond to a cheer or approval reaction made by a user who is watching the video content. It should be noted that reaction panel interface 440 may be expanded to include any suitable graphical icons (e.g., pictograms, embedded smileys, emoticons, gifs, phrases, images, animations, and / or fixed stickers, etc.) and any suitable number of graphical icons for selection by a user who is viewing video content in video area 410. It should also be noted that reaction panel interface 440 may include collapse button 446, which, when selected, causes reaction panel interface 440 to collapse back to reaction panel interface 430.
[0108] In some embodiments, any suitable method may be used to select graphical icons in the reaction panel interface that each correspond to a user reaction. For example, in some embodiments, each of the graphical icons may be selected based on the most popular graphical icons used in a video sharing application to react to a video content item. In another example, in some embodiments, a group of graphical icons may be selected from multiple groups of graphical icons based on video information (e.g., content-related information in video metadata), based on content creator information (e.g., reactions typically provided in a video uploaded by a content creator), based on application information (e.g., reactions typically provided in a messaging application installed on a user device), etc., for provision in the reaction panel interface. In yet another example, in some embodiments, a content creator who uploads a media content item may select a graphical icon or a group of graphical icons to include in the reaction panel interface.
[0109] It should be noted that reaction panel interface 430 can be expanded in any suitable manner. For example, in some embodiments, reaction panel interface 430 can be expanded horizontally from a single graphical icon to a menu of multiple selectable icons. In another example, in some embodiments, reaction panel interface 430 can be expanded vertically, wherein each of the selectable graphical icons can be enlarged to facilitate the user to select one of the graphical icons. In yet another example, go to Figure 5, an illustrative display screen 500 may be presented, where the display screen 500 may include a video area 510 and a like button 530 within a video information panel 520. In the case where the user device is a mobile device with a touch-sensitive display, user input deemed as a short press of like button 530 may be added to a like count associated with the media content item, and user input deemed as a long press of like button 530 (e.g., holding down like button 530 for more than two seconds) may cause reaction panel interface 540 to be displayed to provide a reaction to a moment within the media content item.
[0110] It should be noted that the reaction panel interface 440 may be presented at any suitable location within the display screen 400. For example, Figure 4B As shown, reaction panel interface 440 may be positioned as an overlay within comment panel 420. More specifically, reaction panel interface 440 may be positioned in the lower right portion of comment panel 420 and may be displayed above comments and other comment-related information displayed within comment panel 420. In another example, in response to a reaction prompt presented during the media content item reaching a key moment, reaction panel interface 440 may be presented above progress bar 412 and within video area 410. In a more specific example, in response to reaching a time position in the media content item corresponding to a key moment, a reaction prompt may be presented to the user, such as "React to 1:53 in the video," and in response to selecting the reaction prompt, reaction panel interface 440 may be presented above progress bar 412 and within video area 410 to provide the user with an opportunity to react to that moment within the media content item.
[0111] In some embodiments, when reaction panel interface 440 has been expanded, additional reaction features may be activated within other interface elements of display screen 450 .
[0112] For example, as mentioned above, Figure 4D As described above, when the reaction panel interface 430 is in a collapsed state, a fountain animation of viewer reactions may be presented to indicate viewer reactions when viewer reactions are received. In response to expanding the reaction panel 440, the fountain animation of viewer reactions may be positioned within the video area 410. For example, in the case where the video sharing application is a live video chat application, the selected graphic icon representing the user reaction may be presented with a fountain animation, wherein the received user reaction flows upward and out of the playhead 413 in the progress bar 412.
[0113] In another example, when the reaction panel interface 440 has been expanded to present multiple graphic icons for selecting user reactions to a specific portion of the media content item, the timeline interface including the progress bar 412 and the playhead 413 may be modified to present the aggregated viewer reactions at a specific moment in the media content item. For example, this may provide the user with an opportunity to provide a reaction to a specific moment in the media content item while allowing the user to see how other viewers react to the specific moment in the media content item. In a more specific example, a representative graphic icon corresponding to the aggregated viewer reactions when reaching a specific moment in the media content item may be presented above the playhead 413 in the progress bar 412, for example, a bubble element including a "heart" icon and a count may be presented, the "heart" icon being used to indicate the popular reaction at the specific moment in the media content item, the count indicating the number of "heart" reactions received at the specific moment in the media content item. In another more specific example, where the progress bar is hidden or otherwise disabled from presentation, the progress bar 412 may reappear upon reaching a particular moment within the media content item, wherein a representative graphical icon corresponding to the aggregated viewer reactions may be presented above the playhead 413 .
[0114] In some embodiments, the relative strength of the aggregated viewer reactions at a particular moment in the media content item may be represented by a graphical icon presented above the playhead 413 in the progress bar 412. Continuing with the above example, where the bubble element includes a "heart" icon to indicate the popular reaction at that particular moment in the media content item, different "heart" graphical icons may be selected for presentation in the timeline interface based on the relative strength of the aggregated viewer reactions at the particular moment in the media content item. The selected reaction graphic can be one of the following: a first graphic that includes a single iteration of a representative graphic icon to indicate that a small number of viewers provided the reaction at that moment (e.g., a single heart emoji to indicate that fewer than 10 viewers provided the reaction at that time position within the video); a second graphic that includes three iterations of the representative graphic icon to indicate that a larger number of viewers provided the reaction at that moment (e.g., a graphic icon with three heart emojis to indicate that 10 to 100 viewers provided the reaction at that time position within the video); and a third graphic that includes five iterations of the representative graphic icon to indicate that an even larger number of viewers provided the reaction at that moment (e.g., a graphic icon with five heart emojis to indicate that more than 100 viewers provided the reaction at that time position within the video). For example, Figure 4EAs shown, an audience icon 480 may be presented above the playhead 413 in the progress bar 412, the audience icon indicating the relative strength of the aggregated viewer reactions, wherein the number of hearts in the audience icon indicates that a relatively large number of “heart” reactions have been received at that moment in the media content item. It should be noted that in some embodiments, the presentation of a reaction graphic indicating the relative strength of the aggregated viewer reactions may replace the presentation of a count indicating the number of “heart” reactions (e.g., 1.5k hearts) received at that particular moment in the media content item.
[0115] Alternatively, in some embodiments, a fountain animation may be presented in the video area, which fountain animation may indicate the relative strength of the aggregated viewer reaction at a particular moment in the media content item. For example, when a key moment in the media content item is reached, the fountain animation may be selected based on the relative strength of the aggregated viewer reaction (e.g., for a moment with a relatively small viewer reaction, several hearts rise from the playhead, and for a moment with a relatively large viewer reaction, many hearts rise from the playhead) and may be presented in the video area so that the fountain animation is overlaid on the media content item being played in the video area, wherein the fountain animation may show multiple graphic icons flowing from the playhead and into the media content item. It should be noted that any suitable graphics or animations may be applied to the media content item to represent the aggregated viewer reaction and / or the strength of the aggregated viewer reaction at a certain moment, such as a cascade of representative graphic icons, a larger version of a representative graphic icon, etc.
[0116] It should be noted that in such embodiments, when more than a threshold number of reactions have been received (e.g., the number of reactions is relatively large when compared to a threshold, when compared to previously received reactions, when compared to the total number of reactions received in the media content item, etc.), a representative graphical icon corresponding to the aggregated viewer reactions may be presented. Continuing with this example, when less than a threshold number of reactions have been received, a bubble element including a “heart” icon indicating a popular reaction at that particular moment in the media content item and a count indicating the number of “heart” reactions received at that particular moment in the media content item may disappear or otherwise be prohibited from being presented in the timeline interface.
[0117] It should also be noted that in conjunction with the collapsed state of the reaction panel interface, these additional reaction features may be disabled within other interface elements of display screen 450. For example, in response to collapsing the reaction panel interface (e.g., Figure 4A), the timeline interface including the progress bar 412 and the playhead 413 may be modified to no longer present the aggregated viewer reactions at a particular moment in the media content item. In a more specific example, a bubble element including a "heart" icon and a count indicating the number of "heart" reactions received at that particular moment in the media content item may disappear or otherwise be prohibited from being presented in the timeline interface. The "heart" icon is used to indicate the popular reaction at that particular moment in the media content item, and the count indicates the number of "heart" reactions received at that particular moment in the media content item. In some embodiments, as described above, a single representative icon presented in the collapsed reaction panel interface may continue to transition between different representative graphical icons to provide an indication of aggregated viewer reactions when key moments in the media content item are played.
[0118] Return to reference Figure 3 In response to presenting reaction panel interface 440 during presentation of a media content item, process 300 may receive a user selection of one of the graphical icons corresponding to a reaction at a particular temporal position within the media content item. Figure 4C As shown, in response to presenting reaction panel interface 440 during presentation of a media content item, when the video content item has reached a particular time (e.g., as indicated by the time (5:51 of 24:07) indicated by timestamp 513), process 300 may receive a user selection of an “applause” icon 442 (as indicated by a highlighted area placed around “applause” icon 442).
[0119] It should be noted that in some embodiments, upon receiving a user selection of one of the graphical icons corresponding to a reaction at a particular time position within the media content item, reaction panel interface 440 may transition back to a collapsed state, such as Figure 4A Reaction panel interface 430 is shown.
[0120] In response to receiving a user reaction, process 300 may update the presentation of the media content item to include an indication of the user reaction.
[0121] For example, Figure 4C As shown, in response to presenting reaction panel interface 440 during presentation of a media content item and receiving a user selection of “applause” icon 442 when the video content item has reached a particular time, process 300 may present the selected graphical icon within the video content item. More specifically, as shown in FIG. Figure 4C As shown, the selected “applause” icon 442 may be presented above the playhead 413 in the progress bar 412 for a certain period of time (eg, two seconds).
[0122] In another example, Figure 4CAs shown, in response to presenting reaction panel interface 440 during presentation of a media content item and receiving a user selection of “applause” icon 442 when the video content item has reached a particular time, process 300 may determine whether the selected graphic icon corresponds to a representative graphic icon associated with aggregated viewer reactions. In response to determining that the selected graphic icon corresponds to the representative graphic icon, process 300 may present an animation indicating that the user reaction is the same as the overall audience reaction. For example, Figure 4C As shown, in response to a user selection of the "applause" icon 442 at that particular moment in the video, the process 300 may retrieve stored reactions received from other viewers and associated with the video, determine whether the user reaction matches a popular viewer reaction at that particular moment, and in response, may present an animation that increases the size of a previously presented bubble element above the playhead 413 in the progress bar 412 and adds a "+1" element. For example, this may indicate that the reaction received from the user is consistent with a popular viewer reaction at that moment in the video.
[0123] In some embodiments, different user inputs to reaction panel interface 440 may cause corresponding reactions to be incorporated differently into the presentation of the media content item. For example, in response to receiving multiple selections of a graphical icon within a particular time period (e.g., pressing the “heart” icon ten times within a five-second timespan), an animation may be triggered that incorporates the corresponding reaction into the presentation of the media content item. For example, such an animation may indicate to other viewers and content creators a strong reaction to the content presented at that moment in the media content item. In a more specific example, in response to receiving multiple selections of the “heart” emoji within a five-second timespan from a particular moment presented in a video, a sparkler animation or a fountain animation (similar to a “heart” emoji) may be triggered. Figure 4D ), wherein a plurality of “heart-shaped” objects may be overlaid onto a video content item for a predetermined amount of time, and wherein the plurality of “heart-shaped” objects may fade into the video content item.
[0124] In some embodiments, in response to receiving a selection of a graphical icon during presentation of a media content item, a confirmation interface may be presented. For example, in response to receiving a user selection of the "applause" icon 442 when a video content item has reached a particular time, a confirmation interface may be presented that includes a thumbnail or extracted image of the moment the reaction was received, as well as a description of the reaction and a timestamp associated with the reaction (e.g., "You liked this @ 2:15"). Continuing with this example, the confirmation interface may also provide the user with an opportunity to remove the reaction within a particular time period.
[0125] Return to reference Figure 3In some embodiments, process 300 may store an indication of a user reaction to the media content item at 314. For example, in response to receiving a user-selected graphical icon corresponding to a reaction at a particular time position within the media content item, process 300 may store in a row of a reactions database a media identifier corresponding to the media content item, a creator identifier corresponding to a user account of a content creator who uploaded the media content item, a time reference associated with a time when the reaction was received, a graphical icon (e.g., a "heart" icon) selected by the user, a reaction corresponding to the selected graphical icon, etc. As described above, the reactions database including the stored reactions may be reviewed with other received reactions to determine aggregated viewer reactions within the media content item and identify key moments within the media content item.
[0126] It should be noted that process 300 may be performed any suitable number of times. For example, in some embodiments, process 300 may be performed at a later time during presentation of the same video. Continuing with this example, in some embodiments, the user may initiate a new iteration of process 300 by selecting a selectable graphical icon on the reaction menu panel to submit a second reaction at another time while viewing the video.
[0127] As described herein, each identified key moment in a media content item may be associated with a representative graphical icon, reaction graphic, and / or reaction animation that is presented to a user who is playing the media content item at the time window corresponding to those key moments. Figure 5 As shown, when the video 511 being presented in the video area 510 reaches a specific time corresponding to the time window associated with the identified key moment (e.g., Figure 55:51 / 24:07 in the figure), a representative graphical icon 570 associated with the identified key moment may be presented above the playhead 513 in the timeline interface or above any other suitable indicator of the current play position. In another example, in addition to or in lieu of presenting the representative graphical icon 570, a reaction animation indicating a representative graphical icon at an identified key moment and / or indicating the strength of an aggregated viewer reaction may be presented above the playhead 513, for example, a bubble animation including an enlarged version of the representative graphical icon 570 may temporarily appear above the playhead 513; a bubble animation including an audience icon that indicates both a popular reaction at the identified key moment and a relative strength of the reactions, wherein the size of the audience icon may vary based on the relative strength of the reactions; a fountain animation including a plurality of graphical icons that flow from the playhead 513 and into the media content item being played; a fountain animation that indicates both the popular reaction at the identified key moment by presenting a plurality of graphical icons that flow from the playhead 513 and into the media content item being played, and the relative strength of the reactions based on the number and / or size of the graphical icons that flow from the playhead 513; and a spark animation that appears at or around the representative graphical icon presented above the playhead 513.
[0128] It should be noted that the representative graphic icons, reaction graphics, and / or reaction animations may be positioned at any suitable location on display screen 500. For example, as described above, the representative graphic icons, reaction graphics, and / or reaction animations may be incorporated into a media content item, wherein the representative graphic icons, reaction graphics, and / or reaction animations may cover a portion of the media content item. In another example, as described above, the representative graphic icons, reaction graphics, and / or reaction animations may appear within or around a reaction panel interface (e.g., audience icons that flow out of a collapsed reaction panel interface at key moments). In yet another example, a timed comment pane (such as comment pane 220), a chat interface, or any other suitable area may be updated to include representative graphic icons, reaction graphics, and / or reaction animations at identified key moments. For example, Figure 2 As shown, moment 226 may be presented to include a representative graphical icon indicating a popular reaction selected by viewers of the media content item, a timestamp corresponding to the moment within the video (e.g., time position 1:05 within the video), and an indication of the magnitude of the reaction (e.g., 2,000 viewers provided a reaction via the representative graphical icon).
[0129] It should also be noted that the representative graphical icons, reaction graphics, and / or reaction animations may be presented along with any other suitable information, such as reaction counts (e.g., 1.5k hearts, 2k users reacted, etc.), one or more user avatars indicating users who contributed to the most popular viewer reactions at the identified key moment, an identification of the key moment that has been identified (e.g., a thumbnail image of the key moment and the text “Key Moment”), and the like.
[0130] In addition to presenting representative graphic icons, reaction graphics, and / or reaction animations, key moments identified within a media content item may be indicated along the timeline interface. For example, in an area above the timeline interface, graphic icons representing popular reactions or emotions at identified key moments may be presented above a portion of the timeline interface corresponding to the time window for each key moment (e.g., a "heart" icon at or around 1:00 in the video timeline, a "crying" icon at or around 2:30 in the video timeline, a "celebration" icon at or around 5:00 in the video timeline). For example, this may allow viewers to see identified key moments in a media content item, see audience reactions to each of the identified key moments, and navigate between key moments while traversing a progress bar that is part of the timeline interface.
[0131] In some embodiments, in response to identifying one or more key moments within the media content item, additional user input may be provided that allows the user to navigate between the identified key moments. For example, where the user device is a mobile device with a touch-sensitive display, a double-click input or a swipe input received at the user device may cause the video player application to navigate between the identified key moments, wherein a double-click received at the left portion of the touch-sensitive display or a left swipe input received at the user device may cause the video player application to navigate to the previous key moment based on the current playback position, and a double-click received at the right portion of the touch-sensitive display or a right swipe input received at the user device may cause the video player application to navigate to the next key moment based on the current playback position.
[0132] In some embodiments, in addition to providing a reaction panel interface that allows users to provide reactions to moments within a media content item, identifying key moments based on aggregated viewer reactions, and presenting graphical icons representing aggregated viewer reactions to key moments within a media content item during playback of the media content item, additional features related to identified key moments may be provided to content creators. When reviewing identified key moments and non-moments within a media content item, content creators may, for example, gain an understanding of how viewers feel about different moments within the media content item, gain an understanding of which moments within the media content item provide the most reactions or engagement from viewers, and provide an interactive mechanism between content creators and viewers, wherein content creators may be provided with an opportunity to respond to popular viewer reactions or emotions at identified key moments.
[0133] Go to Figure 6 , shows an example flow diagram of a process 600 for a content creator to present a media content item with viewer reactions, according to some embodiments of the disclosed subject matter.
[0134] In some embodiments, process 600 may be performed on a server (such as server 902) and / or a user device (such as user device 906), as described below in conjunction with Fig. 9 For example, the blocks of process 600 may be performed by a user device (e.g., a mobile phone, a tablet computer, a laptop computer, a desktop computer, a wearable computer, a streaming media device, a smart television, a game console, a vehicle entertainment system, and / or any other suitable user device) that streams video content from a server. Note that in some embodiments, the blocks of process 600 may be performed by an application (e.g., an application associated with a particular video content service and / or any other suitable application) executed on a user device for streaming and presenting video content.
[0135] In some embodiments, process 600 may begin by receiving an indication that a user has accessed an account associated with media content creation or media content sharing at 602. For example, in some embodiments, a content creator may log into an analytics page and / or service associated with a channel that the content creator uses to upload their videos.
[0136] At 604, in some embodiments, process 600 may continue by retrieving at least one video that is associated with the account and that has been identified (e.g., by process 100) as containing key moments and associated aggregated viewer reactions (e.g., popular sentiment at the identified key moments). Process 600 may also retrieve, for example, the received reactions, key moment information, and associated information (e.g., selected graphic icons, reaction panel interface information, reaction type, reaction timestamp, reaction size, etc.) from a reaction database. In some embodiments, process 600 may retrieve the received reactions, key moment information, and associated information for multiple videos.
[0137] At 606, process 600 may cause a graph to be presented that displays the distribution of user reactions received throughout the duration of the video retrieved at 604. In some embodiments, at 606, process 600 may cause any other suitable visualization, graph, spreadsheet, and / or analysis tool to display the reaction data associated with the video retrieved at 604. As a specific example, Figure 7 An illustrative example 700 is shown in which a video display 710 including a video 711 and a reaction chart 720 with a timeline 725 are shown. Figure 7 As shown, reaction chart 720 may display a separate time series 730-760 for each reaction icon associated with video 711. Figure 7 As shown, time series 730 may include data for a “heart” reaction icon titled “Like”. In some embodiments, time series 730 may include a count of total heart reactions for the duration of video 711 (e.g., 25.5k Like reactions). In some embodiments, time series 730 may use any suitable visual identifier to indicate “heart” reactions along timeline 725. For example, Figure 7 As shown, the time series 730 may use color shading, where darker shading indicates more reactions at that point along the timeline 725, while lighter shading indicates little or no reaction to the video at those points in time. Figure 7Each of the time series in 740 may be sorted based on the number of reactions received, where time series 740 may be displayed below time series 730 because time series 740 has fewer total reactions than time series 730. These time series or other reaction data displays may allow content creators to gain an understanding of how viewers feel about different moments within a media content item (e.g., what types of reactions are received throughout the media content item, what types of reactions are received at specific moments within the media content item, etc.), and gain an understanding of which moments within the media content item provide the most reaction or engagement from viewers (e.g., which parts of the media content item elicit a greater number of user reactions, which parts of the media content item elicit few or no user reactions, etc.).
[0138] In some embodiments, display 700 may include any additional features. For example, in some embodiments, time series 730-760 may include indications of automatically identified key moments, as discussed above in process 100.
[0139] Back to Figure 6 , in some embodiments, when the content creator interacts with the displayed reaction data of 606, process 600 can continue at 608. For example, in some embodiments, the content creator can highlight, select, and / or use any other suitable tool to indicate the manual creation of a key moment. As a specific example, the video creator can navigate along any of the time sequences 730-760 to select a start time and an end time, and can designate the selected time window as corresponding to a key moment. In some embodiments, process 600 can add the manually created moment to any existing key moment. For example, in some embodiments, process 600 can add the time window, reaction icons from the selected time sequence, and / or any other suitable information to the metadata of the video.
[0140] At 610 , process 600 may continue when process 600 receives a request from a user device to view a video content item having manually created key moments and / or automatically identified key moments.
[0141] At 612, process 600 may display a representation of a key moment with a video content item. For example, a representation of a key moment may be displayed in a fixed comment area while also displaying a video on a user device. For example, FIG. 8 shows an illustrative example 800 of a display screen for presenting a media content item with viewer reactions. As shown, display 800 may include a video display area 810, a comment panel 820, and a key moment display 830. In some embodiments, video display area 810 may include a video 811. In some embodiments, comment panel 820 may include user-submitted comments ("top comments") sorted by popularity. In addition, in some embodiments, comment panel 820 may include fixed comments 830. In some embodiments, fixed comments 830 may include key moments identified by a content creator, such as discussed at 608 of process 600. As shown in FIG. 8, fixed comments 830 may include an indication of a key moment by displaying a reaction icon 832 and a time window 834 associated with the key moment. In some embodiments, fixed comments 830 may include a message 836 from the creator. In some embodiments, pinned comment 830 may include any suitable graphics, text, hyperlinks, etc.
[0142] In some embodiments, Figure 8B Another example of the representation of the key moment of the identification that can be presented to the content creator is shown. As shown in the figure, except the video display area 810 of the playable video 811, the moment area 840 may include the representation 850 of the key moment of each identification in the media content item. Each key moment representation 850 may include the thumbnail image that can be extracted from the media content item at timestamp or time window 854. In certain embodiments, timestamp 854 may be selectable, and this timestamp can make video 811 be navigated to this specific time in the video when selected by the content creator. The additional information related to the viewer reaction of aggregation can be presented in the representation 850, such as the number 856 of the viewer that provides this specific reaction at this key moment and the graphic icon 858 that the viewer selects most at this key moment.
[0143] In some embodiments, content creators may be provided with the opportunity to respond to popular viewer reactions or emotions at identified key moments. Figure 8B As shown, response button 860 may be presented in representation 850. Continuing with this example, in response to selecting response button 860, an interface may be presented to the content creator for inputting a response to the popular viewer reaction or emotion at the identified key moment. In response to receiving the response from the content creator, the response may be presented to viewers of the media content item. For example, Fig. 8A As shown, the response can be presented as a message 836 from the content creator within the comment panel 820. In another example, as shown in FIG. Figure 2As shown, where moment 226 may include a representative graphical icon indicating a popular reaction or emotion selected by viewers of the video content, a timestamp corresponding to the moment within the video (e.g., time position 1:05 within the video), and an indication of the magnitude of the reaction (e.g., 2,000 viewers provided reactions via the representative graphical icon), message 836 or any other appropriate response to the audience reaction to the key moment may be presented in the timed commentary pane 220 adjacent to moment 226.
[0144] In some embodiments, Figure 8B In the example, the representation of the identified key moments can be organized by the total number of reactions received at that moment or the total number of specific reactions received at that moment. In this way, the response button 860 can provide the content creator with the opportunity to respond to the moment with the greatest reaction (e.g., the favorite moment).
[0145] Go to Fig. 9 , shows an example 900 of hardware according to some embodiments, the hardware for identifying key moments within a media content item based on aggregated timed reactions, presenting the aggregated timed reactions synchronously with the media content item being presented, and generating a reaction interface for receiving a user-selected graphical icon representing a reaction to a moment within the media content item. As shown, the hardware 900 may include a server 902, a communication network 904, and / or one or more user devices 906 (such as user devices 908 and 910).
[0146] Server 902 can be any suitable server for storing information, data, programs, media content and / or any other suitable content.In some embodiments, server 902 can perform any suitable function.
[0147] In some embodiments, the communication network 904 may be any suitable combination of one or more wired and / or wireless networks. For example, the communication network may include any one or more of the following: the Internet, an intranet, a wide area network (WAN), a local area network (LAN), a wireless network, a digital subscriber line (DSL) network, a frame relay network, an asynchronous transfer mode (ATM) network, a virtual private network (VPN), and / or any other suitable communication network. The user device 906 may be connected to the communication network 904 via one or more communication links (e.g., communication link 912), which may be linked to the server 902 via one or more communication links (e.g., communication link 914). The communication link may be any communication link suitable for conveying data between the user device 906 and the server 902, such as a network link, a dial-up link, a wireless link, a hard-wired link, any other suitable communication link, or any suitable combination of such links.
[0148] User device 906 may include any one or more user devices suitable for use with process 100. In some embodiments, user device 906 may include any suitable type of user device, such as a speaker (with or without a voice assistant), a mobile phone, a tablet computer, a wearable computer, a laptop computer, a desktop computer, a smart television, a media player, a game console, a vehicle information and / or entertainment system, and / or any other suitable type of user device.
[0149] Although server 902 is shown as one device, in some embodiments, any suitable number of devices may be used to perform the functions performed by server 902. For example, in some embodiments, the functions performed by server 902 may be implemented using multiple devices.
[0150] although Fig. 9 Two user devices 908 and 910 are shown in FIG. 9 to avoid overcomplicating the diagram, but in some embodiments any suitable number of user devices (including only one user device) and / or any suitable type of user devices may be used.
[0151] In some embodiments, the server 902 and the user device 906 may be implemented using any suitable hardware. For example, in some embodiments, the devices 902 and 906 may be implemented using any suitable general-purpose computer or special-purpose computer and may include any suitable hardware. Fig.10 As shown in example hardware 1000 , such hardware may include a hardware processor 1002 , a memory and / or storage device 1004 , an input device controller 1006 , an input device 1008 , a display / audio driver 1010 , display and audio output circuitry 1012 , a communication interface 1004 , an antenna 1016 , and a bus 1018 .
[0152] In some embodiments, the hardware processor 1002 may include any suitable hardware processor, such as a microprocessor, a microcontroller, a digital signal processor, dedicated logic, and / or any other suitable circuitry for controlling the functions of a general purpose computer or a special purpose computer. In some embodiments, the hardware processor 1002 may be controlled by a computer program stored in the memory and / or storage device 1004. For example, in some embodiments, the computer program may cause the hardware processor 1002 to perform the functions described herein.
[0153] In some embodiments, the memory and / or storage device 1004 may be any suitable memory and / or storage device for storing programs, data, documents, and / or any other suitable information. For example, the memory and / or storage device 1004 may include random access memory, read-only memory, flash memory, hard disk storage, optical media, and / or any other suitable memory.
[0154] In some embodiments, the input device controller 1006 may be any suitable circuit for controlling and receiving input from one or more input devices 1008. For example, the input device controller 1006 may be a circuit for receiving input from a touch screen, from a keyboard, from a mouse, from one or more buttons, from a voice recognition circuit, from one or more microphones, from a camera, from an optical sensor, from an accelerometer, from a temperature sensor, from a near-field sensor, and / or any other type of input device.
[0155] In some embodiments, display / audio driver 1010 may be any suitable circuit for controlling and driving output to one or more display / audio output devices 1012. For example, display / audio driver 1010 may be circuit for driving a touch screen, a flat panel display, a cathode ray tube display, a projector, one or more speakers, and / or any other suitable display and / or presentation device.
[0156] The communication interface 1014 may be a communication interface for communicating with one or more communication networks (such as Fig. 9 The interface 1014 may include any suitable circuitry for interfacing with the network 904 shown in the figure. For example, the interface 1014 may include network interface card circuitry, wireless communication circuitry, and / or any other suitable type of communication network circuitry.
[0157] In some embodiments, antenna 1016 may be any suitable antenna or antennas for wirelessly communicating with a communication network, such as communication network 904. In some embodiments, antenna 1016 may be omitted.
[0158] In some embodiments, bus 1018 may be any suitable mechanism for communicating between two or more components 1002 , 1004 , 1006 , 1010 , and 1014 .
[0159] According to some embodiments, any other suitable components may be included in hardware 1000 .
[0160] In some embodiments, any suitable computer-readable medium may be used to store instructions for performing the functions and / or processes described herein. For example, in some embodiments, the computer-readable medium may be temporary or non-temporary. For example, a non-temporary computer-readable medium may include a medium such as a non-temporary form of magnetic medium (such as a hard disk, a floppy disk, etc.), a non-temporary form of optical medium (such as a compact disk, a digital video disk, a Blu-ray disk, etc.), a non-temporary form of semiconductor medium (such as a flash memory, an electrically programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc.), any suitable medium that is not transient or does not have any permanent appearance during transmission, and / or any suitable tangible medium. As another example, a temporary computer-readable medium may include a signal on a network, a wire, a conductor, an optical fiber, a circuit, any suitable medium that is transient and does not have any permanent appearance during transmission, and / or any suitable intangible medium.
[0161] It should be understood that at least some of the above blocks of processes 100, 300, and 600 may be performed or executed in any order or sequence, including but not limited to: Figure 1 , Figure 3 and Figure 6 In addition, some of the above blocks of processes 100, 300, and 600 may be performed or executed substantially simultaneously, or in parallel, where appropriate, to reduce delays and processing time. Additionally or alternatively, some of the above blocks of processes 100, 300, and 600 may be omitted.
[0162] Although the present invention has been described and shown in the foregoing illustrative embodiments, it should be understood that the present disclosure is carried out by way of example only, and that many changes may be made to the details of the implementation of the present invention without departing from the spirit and scope of the present invention. The features of the disclosed embodiments may be combined and rearranged in various ways.
Claims
1. A method for presenting a media content item with viewer reactions, characterized in that The method comprises: retrieving a plurality of reactions associated with a media content item, wherein each reaction of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item when the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icon; identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receiving a request from a user device to present the media content item; and When a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments, the media content item is rendered in a video window while simultaneously rendering the aggregated viewer reactions within the video window.
2. The method according to claim 1, characterized in that In response to determining that the number of the plurality of reactions is greater than a threshold, the plurality of reactions associated with the media content item are retrieved from a reactions database.
3. The method according to claim 1, characterized in that Also includes: A query is transmitted to a reaction database, the query requesting a count of reactions to the media content item received since a given timestamp, wherein the plurality of reactions associated with the media content item are retrieved based on the count included in a response to the query.
4. The method according to claim 1, characterized in that Also includes: Prior to retrieving the plurality of reactions associated with the media content item, a determination is made as to whether the media content item qualifies for use in identifying the plurality of key moments.
5. The method according to claim 1, characterized in that The plurality of key moments within the media content item are identified by: generating a histogram of each received reaction over time, wherein each reaction is placed within a bucket of the histogram; and An extended bump in the generated histogram is detected as one of the plurality of key moments in the media content item.
6. The method according to claim 5, characterized in that A first extended ridge in the generated histogram is associated with a first time interval, and a second extended ridge in the generated histogram is associated with a second time interval, and wherein the first extended ridge is combined with the second extended ridge in response to the first time interval being separated from the second time interval by less than a threshold time.
7. The method according to claim 1, characterized in that Grouping the plurality of reactions further includes removing the subset of reactions from the plurality of reactions in response to determining that a number of reactions in the subset of reactions associated with the first timestamp is less than a threshold.
8. The method according to claim 1, characterized in that In response to determining that a number of reactions associated with a key moment from the plurality of key moments is greater than a threshold, the key moment is identified, and wherein the representative graphical icon associated with the key moment corresponds to the graphical icon most frequently selected by viewers of the media content item.
9. The method according to claim 1, characterized in that Also includes: A reaction panel interface is caused to be presented in the video window during presentation of the media content item, wherein the reaction panel interface includes a plurality of selectable graphical icons that each correspond to one of the plurality of reactions.
10. The method according to claim 9, characterized in that In response to receiving a user selection of the graphical icon from the plurality of selectable graphical icons in the reaction panel interface, presenting the graphical icon over a playhead in a progress bar of the video window.
11. The method according to claim 10, characterized in that Also includes: Determining whether the graphical icon received at a first time matches the representative graphical icon associated with the moment at the first time, wherein the graphical icon presented above the playhead in the progress bar of the video window is enhanced based on the determination.
12. The method according to claim 9, characterized in that The reaction panel interface has a collapsed state including a single graphical icon.
13. The method according to claim 12, characterized in that In response to receiving a user selection of the single graphical icon, the reaction panel interface transitions from the collapsed state to an expanded state.
14. The method according to claim 12, characterized in that In response to the playback position of the media content item reaching each of the plurality of key moments, the single graphical icon transitions between a first representative graphical icon and a second representative graphical icon, wherein the first representative graphical icon is associated with a first key moment and the second representative graphical icon is associated with a second key moment.
15. The method according to claim 1, wherein: The aggregated viewer reactions are presented simultaneously with the media content item by presenting a graphical representation of the aggregated viewer reactions over a playhead in a progress bar of the video window.
16. The method according to claim 15, characterized in that The graphical representation is an animation that includes a plurality of graphical icons corresponding to the aggregated viewer reactions, and the animation shows the plurality of graphical icons flowing from the playhead in the progress bar of the video window and into the video window.
17. The method according to claim 15, characterized in that The graphical representation is an animation that indicates the aggregate viewer reaction and indicates an intensity of the aggregate viewer reaction, wherein the intensity is based on a number of reactions received at one of the plurality of key moments.
18. The method according to claim 15, characterized in that In response to determining that the current playback position of the media content item does not correspond to the time window associated with one of the plurality of key moments, ceasing to present the graphical representation.
19. The method according to claim 1, wherein: The reaction panel interface has an expanded state, the expanded state comprising a plurality of selectable graphical icons, each of the plurality of selectable graphical icons corresponding to one of the plurality of reactions, and wherein, in response to the reaction panel interface being in the expanded state, the media content item is activated to be presented in the video window simultaneously with the aggregated viewer reactions.
20. A system for presenting a media content item with viewer reactions, characterized in that The system comprises: A hardware processor, wherein the hardware processor is configured to: retrieving a plurality of reactions associated with a media content item, wherein each reaction of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item when the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icon; identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receiving a request from a user device to present the media content item; and When a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments, the media content item is rendered in a video window while simultaneously rendering the aggregated viewer reactions within the video window.
21. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for presenting a media content item with a viewer reaction, characterized in that: The method comprises: retrieving a plurality of reactions associated with a media content item, wherein each reaction of the plurality of reactions comprises a reaction timestamp corresponding to a time within the media content item when the reaction was received and a graphical icon selected from a plurality of graphical icons, the plurality of graphical icons each corresponding to one of the plurality of reactions; grouping the plurality of reactions based on the reaction timestamps and based on the selected graphical icon; identifying a plurality of key moments within the media content item based on the grouping of the plurality of reactions, wherein each of the plurality of key moments is associated with a representative graphical icon corresponding to an aggregated viewer reaction; receiving a request from a user device to present the media content item; and When a current playback position of the media content item corresponds to a time window associated with each of the plurality of key moments, the media content item is rendered in a video window while simultaneously rendering the aggregated viewer reactions within the video window.
