DYNAMIC GENERATION OF TRICK MODE DATA
Patent Information
- Application Number
- DE602016091300
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2015-08-31
- Filing Date
- 2016-08-29
- Publication Date
- 2025-02-19
- Estimated Expiration
- 2036-08-29
AI Technical Summary
Existing media streaming technologies do not allow viewers to perform trick mode operations, such as fast forward and rewind, on media content that is not trick mode enabled.
A method and system for dynamically generating trick mode data while streaming media content, where a media device retrieves key frames from the media content and converts them into trick mode data, enabling trick mode operations even for media content not originally trick mode enabled.
Enables viewers to perform trick mode operations, such as fast forward and rewind, on any media content being streamed, enhancing user interaction and flexibility in media consumption.
Description
FIELD
[0001] The field relates generally to trick mode data, and more specifically to generating trick mode data when streaming media content.BACKGROUND
[0002] Media content may include secondary content which enables a viewer to perform a trick mode operation on the media content. However, not all media content includes the secondary content that enables trick mode. When the media content does not include secondary content, a viewer is unable to execute a trick mode operation when viewing media content.
[0003] US2009 / 265737A1 discloses systems and methods for obtaining key frames of video content items being viewed by first users and publishing the key frames of the video content items to second users. In general, either prior to playback of a video content item by a first user or during playback of the video content item by the first user, key frame information providing, referencing, or identifying key frames of the video content item is obtained. Each key frame is representative of a segment of the video content item. The key frame information for the video content item is then published such that each key frame is presented to one or more second users while the first user views the corresponding segment of the video content item.
[0004] US2012 / 170642A1 discloses systems and methods for performing smooth visual search of media encoded for adaptive bitrate streaming using trick play streams. One example includes transcoding a selected portion of the source video into a portion of trick play stream video for inclusion in a trick play stream using the source encoder, where the portion of trick play stream video is encoded at a lower frame rate and a lower resolution than the source video, writing the trick play stream to a separate container file using the source encoder, and adding an entry to an index that identifies the location of each frame in the portion of trick play stream video within the container file containing the trick play stream.BRIEF SUMMARY
[0005] According to a first aspect of the present invention there is provided a method as specified in claim 1. The method may optionally be as specified in any one of claims 2 to 5.
[0006] According to a second aspect of the present invention there is provided a system as specified in claim 6. The system may optionally be as specified in any one of claims 7 to 11.
[0007] Further features and advantages of embodiments, as well as the structure and operation of various embodiments, are described in detail below with reference to the accompanying drawings. It is noted that the embodiments are not limited to the specific embodiments described herein. Such embodiments are presented herein for illustrative purposes only. Additional embodiments will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein.BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The accompanying drawings are incorporated herein and form a part of the specification. FIG. 1 is a block diagram of a system where example embodiments may be implemented. FIG. 2 is a block diagram of a media device generating trick mode data, according to an embodiment. FIG. 3 is a block diagram of a media content stream, according to an embodiment. FIG. 4 is a block diagram of a system including multiple media devices generating trick mode data from the same media content, according to an embodiment. FIG. 5 is a block diagram of a system where a media device performs a trick mode operation using trick mode data, according to an embodiment. FIG. 6 is a flowchart of a method for dynamically generating trick mode data, according to an embodiment. FIG. 7 is a flowchart of a method for dynamically generating trick mode data, according to an embodiment. FIG. 8 is a flowchart of a method for performing a trick mode operation, according to an embodiment. FIG. 9 is an exemplary computing device where various embodiments can be implemented.
[0009] In the drawings, like reference numbers generally indicate identical or similar elements. Additionally, generally, the left-most digit(s) of a reference number identifies the drawing in which the reference number first appears.DETAILED DESCRIPTION
[0010] Provided herein are system, method and / or computer program product embodiments, and / or combinations and sub-combinations thereof, for dynamically generating trick mode data while streaming media content on a media device. A media device uses trick mode data to perform trick mode operations. The trick mode operations include at least fast forward and rewind operations at one or more speeds.
[0011] FIG. 1 is a block diagram of a system 100 where example embodiments may be implemented. System 100 allows a viewer to perform trick mode operations on the streaming media content that is not enabled for trick mode operations. In an embodiment, the streaming media content is content which is transmitted or streamed over a network, such as the Internet. The streaming media content is also viewed on a streaming enabled electronic device at the same time as the streaming media content is streamed over the network. In an embodiment, the streaming media content may also be stored and viewed later.
[0012] In an embodiment, system 100 includes a media device 102. Example media device 102 may be a portable or non-portable electronic device, such as, a desktop, a laptop, a smartphone, a tablet, a data streaming device, such as, but not limited to, a streaming stick or a streaming player, a television set, a set-top box, or a media player to name a few non limiting examples. Media device 102 may also be a portable device that may be transported to different locations and be connected to a television set or another device that receives media content via media device 102 and displays the media content at one of these different locations.
[0013] In another example, media device 102 may be a data streaming device. A data streaming device receives, processes, and provides media content, including streaming media content, over a network for display on a television set or another media enabled display device that has, or is coupled to, a display screen. In yet another embodiment, media device 102 may be part of, or integrated with a television or another viewing device.
[0014] In an embodiment, media device 102 may include computer hardware, including a memory, a processor and a communication interface, as well as combinations and / or sub-combinations thereof, that are described, for example, in detail in FIG. 9.
[0015] In an embodiment, media device 102 receives and / or displays media content 104. Media content 104 may be one or more of text, audio, still images, video, etc. In a further embodiment, media content 104 may be streaming content. Example streaming content includes multimedia content, such as, movies, television episodes, advertisements, commercials, news, streaming channels, video clips, video games, on-demand video content, music, and photos organized into a video enhanced photo album. Example streaming content also includes audio and Internet content, to name a few examples.
[0016] In an embodiment, media device 102 utilizes one or more networks, collectively referred to as network 106. In an embodiment, media device 102 obtains media content 104 using network 106. There may be multiple media devices 102 connected to network 106. In an embodiment, network 106 may be a wired and / or wireless network, including a network having interconnected computer networks, referred collectively as the Internet. In an embodiment, network 106 may include private, public, academic, business, and government networks that includes access to extensive amounts of information and resources. Network 106 may also include cellular and / or other communication mediums.
[0017] In an embodiment, content server 108 is also connected to network 106. Content server 108 stores, accesses, processes, and / or distributes media content 104 over network 106 to, for example, media devices 102. To store media content 104, content server 108 may interface with database storage 110. Database storage 110 includes non-volatile storage discussed in FIG. 9, that is conducive to storing large amounts of information, including, media content 104.
[0018] In an embodiment, content sources 112 provide media content 104 to content server 108. Content sources 112 generate, distribute, process, and / or otherwise provide media content 104 to content server 108 for eventual distribution and viewing using media devices 102. For example, content sources 112 may transmit media content 104 via network 106 to content server 108 and database storage 110. Media content 104 may then be distributed to media devices 102. In an embodiment, media device 102 may request media content 104 from content server 108. When content server 108 receives a request for media content 104, content server 108 may retrieve media content 104 and provide media content 104 to media device 102. For example, content server 108 may request media content 104 from database storage 110 or content source 112. Once content server 108 receives the requested media content 104 from database storage 110 or content source 112, content server 108 transmits media content 104 to media device 102.
[0019] In an embodiment, media content 104 may or may not be trick mode enabled. A trick mode is an ability to fast forward, rewind, pause, or otherwise manipulate media content 104 during viewing at one or more speeds. Content source 112 may determine whether media content 104 is trick mode enabled. For example, content source 112 may generate a trick mode file that stores trick mode data before media content 104 is distributed to content server 108 and streamed using media device 102. A non-limiting example of trick mode data is a chronological timeline made up of image frames that correspond to distinct frames in media content 104. The timeline may be at predefined or variable time intervals. These image frames are reduced in size from a corresponding frame included in media content 104. Content source 112 may then store the trick mode data in a trick mode file, or as part of, or together with, media content 104 at a location accessible to content server 108.
[0020] When media device 102 requests media content 104, content server 108 transmits the requested media content 104 as well as the associated trick mode data to media device 102. The transmission of trick mode data may be out-of-band from media content 104, so that the transmission does not affect streaming or download of media content 104. Example out-of-band transmission may be transmission before media content 104 is streamed to media device 102 or when media content 104 is paused as it is streamed, etc. When media device 102 receives a trick mode request (such as a request from a viewer to rewind or fast forward), media device 102 accesses the trick mode data and uses the trick mode data to perform trick mode operations (i.e., the requested rewind or fast forward, for example) on media content 104.
[0021] In an embodiment where media content 104 is not trick-mode enabled, conventional media devices cannot perform trick mode operations on media content 104. In an embodiment, media device 102 is able to dynamically generate trick mode data from media content 104 as media content 104 is being streamed from content server 102 to media device 102. Once media device 102 dynamically generates trick mode data, media device 102 uses the generated trick mode data to perform trick mode operations on media content 104.
[0022] FIG. 2 is a block diagram 200 of a media device generating trick mode data from streaming media content, according to an embodiment. Block diagram 200 includes media device 102. In an embodiment, media device 102 includes a network interface 202. Network interface 202 includes a receiver and a transmitter which allow media device 102 to communicate with network 106. For example, a transmitter may transmit a request for media content 104 to content server 108 and a receiver may receive media content 104 from content server 108. In another example, network interface 202 may include an application interface or an API that formats requests for media content 104 and receives media content 104.
[0023] In an embodiment, media device 102 may include a media content processor 204. Media content processor 204 dynamically generates trick mode data as media device 102 receives and / or streams media content 104. In one embodiment, to generate trick mode data, media content processor 204 retrieves key frames 206 from media content 104 when, for example, media device 102 streams media content 104. Key frames 206 are used to generate trick mode data and may be derived from any information in media content 104, including but not limited to, the frames in the encoded video data.
[0024] Media content processor 204 identifies, selects and / or retrieves key frames 206 at predefined time intervals and / or variable time intervals and stores key frames 206 as trick mode data in the trick mode data storage 208. Trick mode data storage 208 may be a volatile or non-volatile storage on or coupled to media device 102, and may be one of the storages described in FIG. 9. Media content processor 204 may use network interface 202 to upload key frames 206 to content server 108. Content server 108 then stores key frames 206 as trick mode data in database storage 110, and transmits the trick mode data to one or more media devices 102 upon request. In an alternative embodiment, the foregoing operations may be performed on a previously streamed media content that is stored in media device 102.
[0025] As discussed above, media content processor 204 retrieves key frames 206 at predetermined time intervals. Example time intervals may be 10 or 20 seconds. Each key frame may be tagged, or otherwise correspond, to an actual location of a frame in media content 104 or the time from the beginning of media content 104.
[0026] Media content processor 204 uses key frames 206 to generate trick mode data. For example, media content processor 204 may select all or a subset of key frames 206 and store them in a chronological order in a trick mode file or volatile memory storage that exists as long as media content 104 is streamed to media device 102 and / or for a predefined period thereafter. Media content processor 204 may also append the trick mode data with more key frames 206 as media device 102 continues to stream media content 104. In a further embodiment, media content processor 204 may also convert key frames 206 to a different format, if needed. For example, media content processor 204 may compress key frames 206 from the format of media content 104 which is used to display media content 104 to another less memory intensive format. In another example, media device 102 may receive portions of media content 104, where each portion is in a different format. Media content processor 204 retrieves key frames 206 from the portions of media content that media device 104 received in different formats, and converts key frames 206 to a common format.
[0027] As media content 104 streams to media device 102, a user may activate trick mode. For example, a user may use a remote control, a smartphone acting as a remote control, or one or more selections or buttons on media device 102 to activate pause, rewind, or fast forward functions at one or more speeds. Such operations are called trick mode operations since they involve trick mode data. When a viewer activates a trick mode on media device 102, media content processor 204 may identify a key frame in the trick mode data storage 208 or a trick mode data file that is located approximately at the location where the viewer was viewing media content 104 when the trick mode was activated. Media device 102 then uses trick mode data to perform the trick mode operation.
[0028] In another embodiment, as media content 104 streams to media device 102, media content processor 204 may identify key frames 206 based on characteristics of frames in media content 104. For example, media content 104 may be encoded using key frames and non-key frames, as illustrated using FIG. 3, below.
[0029] FIG. 3 is a block diagram of a media stream 300 according to an embodiment. Media stream 300 can be media content 104 that is streamed to media device 102. In an embodiment, media stream 300 is divided into key frames 302a-c and non-key frames 304a-z. Key frames 302a-c and non-key frames 304a-z differ in encoding. For example, key frames 302a-c in media content 104 may be encoded without reference to other frames, such as non-key frames 304a-z, and represent a complete frame or an image without relying on preceding or subsequent frames. Non-key frames 304a-z, on the other hand, do not represent a complete image. Instead, non-key frames 304a-z may represent changes or deltas between non-key frames 304a-z and key frames 302a-c. For example, non-key frame 304a is combined with a corresponding key frame 302a to generate a complete image that is shown using media device 102. As shown in FIG. 3, there may be multiple non-key frames, such as, non-key frames 304b-d between key frames, such as key frames 302a and 302b.
[0030] Key frames 302a-c include an identifier or a descriptor which identifies the frames as key frames 302a-c, and non-key frames 304a-z include an identifier or a descriptor which identifies the frames as non-key frames 304a-z.
[0031] Going back to FIG. 2, media content 104 may be encoded using different compression / decompression or CODEC techniques. Example CODEC techniques include H.264, MPEG2, H.265, etc., and all are well-known in the art. In a further embodiment, media content 104 may also be streamed from content server 108 to media device 102 using HTTP Live Streaming, etc. Also, in some embodiments, different portions of media content 104 may be physically stored on different content servers 108 and also may be encoded using different CODEC techniques when the portions of the media content 104 are delivered to media device 102.
[0032] In an embodiment, media content 104 or a portion of a media content 104 encoded and / or delivered using different CODEC and delivery techniques is media stream 300 described in FIG. 3. In an embodiment, when media content processor 204 receives and / or displays media content 104, media content processor 204 extracts key frames 302a-c from media content 104. Media content processor 204 then stores some or all key frames 302a-c in trick mode data storage 208. In a further embodiment, media content processor 204 may select key frames 302a and 302c when media content processor 204 determines that the time interval between key frame 302a and 302c is greater than a predetermined time interval, but the time interval between key frames 302a and 302b is less than the predefined time interval. Generally, media content processor 204 selects key frames for inclusion into trick mode data such that the selected key frames form trick mode data that is sufficient to perform trick mode operations. Media content processor 204 then stores the selected key frames, such as, key frames 302a and 302c in, for example, trick mode file and / or trick mode storage 208.
[0033] Going back to FIG. 2, media content processor 204 reformats key frames 206. In particular, media content processor 204 transcodes key frames 206 into a different format that is efficient for storing trick mode data and takes up less memory space than the frames in media content 104. Example transcoding may include scaling, changing encoding format, or adding visual enhancements to key frames 206. In a further embodiment, key frames 206 may also be selected and saved in a way that optimizes the spacing between key frames 206, such that the spacing between the frames is consistent throughout media content 104.
[0034] In a further embodiment, multiple media devices 102 may identify key frames 206 for the same media content 104. For example, when media content 104 is streamed to multiple media devices 102, each media device identifies key frames 206 from in media content 104. In this way, multiple media devices 102 generate trick mode data for the same media content 104. The generated trick mode data may then be combined using content server 108, another server, or media device 102, in a crowd-sourcing type embodiment.
[0035] FIG. 4 is a block diagram of a system 400 including multiple media devices generating trick mode data from the same media content, according to an embodiment. For example, multiple media devices 402a-c receive the same media content 404 from content server 408. Content server 408 delivers media content 404 at the same or different times to media devices 402a-c, or delivers different portions of media content 404 to media devices 402a-c. For example, media device 402a may receive media content 404a, media device 402b may receive media content 404b, and media device 402c may receive media content 404c. Media content processors 410a-c process the respective media content 404a-c on media devices 402a-c as media content 404a-c is streamed from content server 408. For example, media content processor 410a retrieves key frames 412a-c, media content processor 410b retrieves key frames 412d-f, and media content processor 410c retrieves key frames 412h-j. Notably, key frames 412a-c, 412d-f, and 412h-j (even when corresponding to the same content) may be the same or different key frames, as they are generated on different media devices 402a-c.
[0036] In an embodiment, media content 404a-c may be transmitted to each of media devices 402a-c in a different format, such that media device 402a receives media content 404a in format 405a, media device 402b receives media content 404b in format 405b, and media device 402c receives media content 404c in format 405c.
[0037] In an embodiment, media devices 402a-c may store key frames 412a-c, 412d-f, and 412h-j in the respective trick mode data storages 414a-c of the respective media device 402a-c. In another embodiment, media devices 402a-c may transmit key frames 412a-c, 412d-f, and 412h-j to content server 408 or another crowd sourcing server.
[0038] In an embodiment, content server 408 also includes a frame processor 416. Frame processor 416 receives key frames 412a-c, 412d-f, and 412h-j from media devices 402a-c, and selects some or all key frames 412a-c, 412d-f, and 412h-j for inclusion into trick mode data. For example, frame processor 416 may identify a location of each one of key frames 412a-c, 412d-f, and 412h-j in media content 404 and selects some or all key frames 412a-c, 412d-f, and 412h-j as trick mode data. Frame processor 416 may select key frames 412a-c, 412d-f, and 412h-j based on the key frames' 412a-c, 412d-f, and 412h-j locations in media content 404 as well as key frames' location from each other. For example, frame processor 416 may select key frames for inclusion into trick mode data, such that key frames 412a-c, 412d-f, and 412h-j are located at predefined time intervals from each other.
[0039] For example, suppose key frame 412a-c, 412d-f, and 412h-j occur in media content 404 at a time as shown in a table below: Table 1FrameTime412a30 minutes, 10 seconds412b30 minutes, 40 seconds412c31 minutes, 10 seconds412d30 minutes, 20 seconds412e30 minutes, 30 seconds412f30 minutes, 40 seconds412h45 minutes, 10 seconds412i45 minutes, 20 seconds412j45 minutes, 30 seconds
[0040] In an embodiment where frame processor 416 selects a key frame every 10 seconds, frame processor 416 may select key frames 412a, 412d, 412e, 412f, 412c and 412h-j. In another embodiment where frame processor 416 selects a key frame every 20 seconds, frame processor 416 may select key frames 412a, 412e, 412c, 412h, and 412j. Frame processor 416 stores the selected key frames, such as key frames 412a, 412e, 412h, and 412j in chronological order as trick mode data 418, using, for example, trick mode data file or another form of storage. In an embodiment, content server 408 may store trick mode data 418 in a memory included or coupled to content server 408.
[0041] In a further embodiment, media content processors 410a-c may also select some or all key frames from the respective key frames 412a-c, 412d-f, and 412h-j, as described above, before transmitting the selected key frames to content server 408.
[0042] In an embodiment, either media content processors 410a-c or frame processor 416 may also modify the format of key frames 412a-c, 412d-f, and 412h-j as discussed above, such that key frames included in trick mode data 418 are in the same format.
[0043] In an embodiment, when media device 402a receives a trick mode request from a viewer, media device 402a may transmit the trick mode request (or a request for trick mode data relating to the rick mode request) to content server 408. In response to the request, content server 408 may transmit trick mode data 418 to media device 402a. Once received, media device 402a implements the trick mode operation using the received trick mode data 418.
[0044] FIG. 5 is a block diagram of a system 500, where a media device performs a trick mode operation using trick mode data, according to an embodiment. In system 500, a trick mode operation may be performed using trick mode data obtained on a media device 502 and / or content server 508 via network 506.
[0045] For example, trick mode data 510a may be obtained as described in FIG. 4 and stored in memory included or coupled to content server 508. Media device 502 may stream media content 504 and dynamically generate trick mode data 510b. In another embodiment, trick mode data 510b may also be downloaded to media device 502 out-of-band from media content 504, and stored in the memory included in media device 502.
[0046] When a viewer initiates a trick mode operation, media device 502 may use a combination of trick mode data 510a and 510b to perform the trick mode operation. For example, media device 502 may use trick mode data 510b to perform a rewind operation. And, media device 502 may use trick mode data 510a to perform a fast forward operation when trick mode data 510a includes portions of media content 504 that has not yet been streamed to media device 502 and are not available using trick mode data 510b. In this embodiment, when media device 502 receives a fast forward request, media device 502 determines whether trick mode data 510b includes key frames that are beyond the point in time where media content 504 has been streamed to media device 502, and requests trick mode data 510a from content server 508. Once media device 502 receives trick mode data 510a, which may be out-of-band with media content 504, media content processor 512 identifies the location in trick mode data 510a from where to begin the fast forward operation, and performs the fast forward operation using trick mode data 510a. In a non-limiting embodiment, media content processor 512 may identify the location in trick mode data from where to perform the fast forward operation by comparing the identifier of a key or non-key frame in media content 504 when trick mode operation was requested to an identifier of a frame in trick mode data 510a.
[0047] In yet another embodiment, media device 502 may receive a pause request from a viewer. In response, media device 502 may pause the viewing of media content 504. To pause media content 504, media device 502 may continue to stream media content 504 but also temporarily store media content 504 received after the pause request in the memory (such as volatile cache memory) of media device 502. In this way, the pause functionality may be transparent to content server 508.
[0048] In an embodiment, media device 102 may continue to generate trick mode data during the pause. For example, while media device 502 pauses media content 504, media content processor 512 may continue to retrieve key frames from media content 504 and store these key frames as trick mode data 510b. In this way, when media device 502 receives a fast forward trick mode command, media device 502 may use trick mode data 510b, or a combination of trick mode data 510a and 510b to perform a fast forward operation. In yet, another embodiment, media device 502 may use trick mode data 510b to perform a rewind operation.
[0049] FIG. 6 is a flowchart of a method 600 for dynamically generating trick mode data, according to an embodiment.
[0050] At operation 602, a media device receives media content. For example, network interface 202 receives media content 104 from content server 108. As discussed above, media content 104 can be streaming video content which media device 102 streams and displays in real-time.
[0051] At operation 604, key frames are identified. For example, as media device 102 streams media content 104, media content processor 204 identifies key frames 206. As discussed above, media content processor 204 may identify key frames 206 based on predetermined or variable time intervals. As also discussed above, media content processor 204 may identify key frames 206 as frames in media content 104 that generate an image independent of other frames.
[0052] At operation 606, key frames are converted into trick mode data. For example, media content processor 204 converts key frames 206 from the format associated with media content 104 into a trick mode format. To convert key frames 206, media content processor 204 may convert a key frame into a different format and / or select a subset of key frames 206 such that trick mode data includes key frames in chronological order and at predefined or variable time intervals.
[0053] At operation 608, trick mode data is stored. Media content processor 204 uploads the trick mode data to content server 108.
[0054] FIG. 7 is a flowchart of a method 700 for dynamically generating trick mode data, according to an embodiment.
[0055] At operation 702, multiple media devices receive the same media content. For example, media devices 402a-c receive media content 404a-c from content server 108, where media content 404a-c is the same media content 404.
[0056] At operation 704, each media device identifies key frames. For example, media device 402a identifies key frames 412a-c, media device 402b identifies key frames 412d-f, and media device 402c identifies key frames 412h-j, which may be the same or different key frames.
[0057] At operation 706, each media device transmits its respective key frames to a content server or another crowd server. For example, media device 402a transmits key frames 412a-c to content server 408, media device 402b transmits key frames 412d-f to content server 408, and media device 402c transmits key frames 412h-j to content server 408. Prior to transmission, media devices 402a-c may also convert the respective key frames 412a-c, 412d-f, and 412h-j to a different format, as described above.
[0058] At operation 708, the content server converts the key frames into trick mode data. For example, frame processor 416 selects a subset of key frames from key frames 412a-c, 412d-f, and 412h-j as trick mode data 418. Frame processor 416 may also change the key frames selected as trick mode data 418 into a common format and store trick mode data 418.
[0059] FIG. 8 is a flowchart of a method 800 for performing a trick mode operation, according to an embodiment.
[0060] At operation 802, a trick mode is activated. For example, media device receives a request from a user to perform a trick mode operation.
[0061] At operation 804, media device accesses or retrieves trick mode data. For example, media device 502 may retrieve trick mode data 510b stored within media device 502, or retrieve trick mode data 510a from content server 508. In an embodiment, media device 502 may retrieve trick mode data 510a when media content processor 512 determines that the requested trick mode operation cannot be performed using trick mode data 510b.
[0062] At operation 806, a trick mode operation is performed. For example, media device 502 performs the trick mode operation using the trick mode data 510a, 510b, or 510a-b.
[0063] Various embodiments can be implemented, for example, using one or more well-known computer systems or one or more components included in computer system 900 shown in FIG. 9. Computer system 900 can be any well-known computer capable of performing the functions described herein.
[0064] Computer system 900 includes one or more processors (also called central processing units, or CPUs), such as a processor 904. Processor 904 is connected to a communication infrastructure or bus 906.
[0065] One or more processors 904 may each be a graphics processing unit (GPU). In an embodiment, a GPU is a processor that is a specialized electronic circuit designed to process mathematically intensive applications. The GPU may have a parallel structure that is efficient for parallel processing of large blocks of data, such as mathematically intensive data common to computer graphics applications, images, videos, etc.
[0066] Computer system 900 also includes user input / output device(s) 903, such as monitors, keyboards, pointing devices, etc., that communicate with communication infrastructure 906 through user input / output interface(s) 902.
[0067] Computer system 900 also includes a main or primary memory 908, such as random access memory (RAM). Main memory 908 may include one or more levels of cache. Main memory 908 has stored therein control logic (i.e., computer software) and / or data.
[0068] Computer system 900 may also include one or more secondary storage devices or memory 910. Secondary memory 910 may include, for example, a hard disk drive 912 and / or a removable storage device or drive 914. Removable storage drive 914 may be a floppy disk drive, a magnetic tape drive, a compact disk drive, an optical storage device, tape backup device, and / or any other storage device / drive.
[0069] Removable storage drive 914 may interact with a removable storage unit 918. Removable storage unit 918 includes a computer usable or readable storage device having stored thereon computer software (control logic) and / or data. Removable storage unit 918 may be a floppy disk, magnetic tape, compact disk, DVD, optical storage disk, and / or any other computer data storage device. Removable storage drive 914 reads from and / or writes to removable storage unit 918 in a well-known manner.
[0070] According to an exemplary embodiment, secondary memory 910 may include other means, instrumentalities or other approaches for allowing computer programs and / or other instructions and / or data to be accessed by computer system 900. Such means, instrumentalities or other approaches may include, for example, a removable storage unit 922 and an interface 920. Examples of the removable storage unit 922 and the interface 920 may include a program cartridge and cartridge interface (such as that found in video game devices), a removable memory chip (such as an EPROM or PROM) and associated socket, a memory stick and USB port, a memory card and associated memory card slot, and / or any other removable storage unit and associated interface.
[0071] Computer system 900 may further include a communication or network interface 924. Communication interface 924 enables computer system 900 to communicate and interact with any combination of remote devices, remote networks, remote entities, etc. (individually and collectively referenced by reference number 928). For example, communication interface 924 may allow computer system 900 to communicate with remote devices 928 over communications path 926, which may be wired and / or wireless, and which may include any combination of LANs, WANs, the Internet, etc. Control logic and / or data may be transmitted to and from computer system 900 via communication path 926.
[0072] In an embodiment, a tangible apparatus or article of manufacture comprising a tangible computer useable or readable medium having control logic (software) stored thereon is also referred to herein as a computer program product or program storage device. This includes, but is not limited to, computer system 900, main memory 908, secondary memory 910, and removable storage units 918 and 922, as well as tangible articles of manufacture embodying any combination of the foregoing. Such control logic, when executed by one or more data processing devices (such as computer system 900), causes such data processing devices to operate as described herein.
[0073] Based on the teachings contained in this disclosure, it will be apparent to persons skilled in the relevant art(s) how to make and use embodiments of the invention using data processing devices, computer systems and / or computer architectures other than that shown in FIG. 9. In particular, embodiments may operate with software, hardware, and / or operating system implementations other than those described herein.
[0074] It is to be appreciated that the Detailed Description section, and not the Summary and Abstract sections (if any), is intended to be used to interpret the claims. The Summary and Abstract sections (if any) may set forth one or more but not all exemplary embodiments of the invention as contemplated by the inventor(s), and thus, are not intended to limit the invention or the appended claims in any way.
[0075] While the invention has been described herein with reference to exemplary embodiments for exemplary fields and applications, it should be understood that the invention is not limited thereto. Other embodiments and modifications thereto are possible, within the scope of the appended claims. For example, and without limiting the generality of this paragraph, embodiments are not limited to the software, hardware, firmware, and / or entities illustrated in the figures and / or described herein. Further, embodiments (whether or not explicitly described herein) have significant utility to fields and applications beyond the examples described herein.
[0076] Embodiments have been described herein with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined as long as the specified functions and relationships (or equivalents thereof) are appropriately performed. Also, alternative embodiments may perform functional blocks, steps, operations, methods, etc. using orderings different than those described herein.
[0077] References herein to "one embodiment," "an embodiment," "an example embodiment," or similar phrases, indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it would be within the knowledge of persons skilled in the relevant art(s) to incorporate such feature, structure, or characteristic into other embodiments whether or not explicitly mentioned or described herein.
[0078] The breadth and scope of the invention should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims.
Claims
1. A method, comprising: receiving media content (104, 404, 504) on a media device (102, 402, 502) from a content server (108, 408, 508), wherein the media content (104, 404, 504) includes key frames (302) that include a descriptor that identifies the frames as key frames (302), and non-key frames (304) that include a descriptor that identifies the frames as non-key frames (304); identifying, by the media device (102, 402, 502), a plurality of key frames (206, 412) from the key frames (302) included in the media content (104, 404, 504) as the media content is streamed using the media device (102, 402, 502); converting, by the media device (102, 402, 502), the plurality of key frames (206, 412) into trick mode data during the streaming, wherein the trick mode data enable a trick mode operation to be performed on the media content (104, 404, 504), wherein the trick mode operation includes a fast forward operation, a rewind operation, or a pause operation, and wherein converting the plurality of key frames into the trick mode data includes transcoding at least one key frame of the plurality of key frames (206, 412) into a format different from a format for the at least one key frame; and uploading, by the media device (102, 402, 502), the trick mode data including the at least one transcoded key frame to the content server (108, 408, 508), wherein the content server (108, 408, 508) is configured to provide at least some of the trick mode data to a second media device, wherein the identifying the plurality of key frames (206, 412) comprises selecting the plurality of key frames (206, 412) from the key frames (302) included in the media content (104, 404, 504) at predetermined time intervals, and wherein the converting further comprises reducing a size of the plurality of key frames (206, 412).
2. The method of claim 1, wherein the plurality of key frames (206, 412) from the media content (104, 404, 504) includes a key frame that forms a complete image in the media content (104, 404, 504).
3. The method of claim 1, wherein the media content (104, 404, 504) is streaming media content, and the streaming media content is streamed from the content server (108, 408, 508) over a network as the streaming media content is displayed using the media device (102, 402, 502).
4. The method of claim 1, wherein the content server (108, 408, 508) is configured to provide at least some of the trick mode data to the second media device when the second media device requests the trick mode operation.
5. The method of claim 1, further comprising: pausing the media content (104, 404, 504); generating the trick mode data during the pausing; and storing the media content (104, 404, 504) during the pausing, wherein the media content (104, 404, 504) continues to stream to the media device (102, 402, 502) during the pausing, and the generating further comprises identifying the at least one key frame from the stored media content.
6. A system (100, 400, 500) comprising: a content server (108, 408, 508); and a media device (102, 402, 502) comprising: a network interface configured to receive media content (104, 404, 504) on the media device from the content server (108, 408, 508), wherein the media content (104, 404, 504) includes key frames (302) that include a descriptor that identifies the frames as key frames (302), and non-key frames (304) that include a descriptor that identifies the frames as non-key frames (304); and a processor configured to: identify a plurality of key frames (206, 412) from the key frames (302) included in the media content (104, 404, 504) as the media content is streamed using the media device; convert the plurality of key frames (206, 412) into trick mode data during the streaming, wherein the trick mode data enable a trick mode operation to be performed on the media content (104, 404, 504), wherein the trick mode operation includes a fast forward operation, a rewind operation, or a pause operation, and wherein converting the plurality of key frames into the trick mode data includes transcoding at least one key frame of the plurality of key frames into a format different from a format for the at least one key frame; and upload the trick mode data including the at least one transcoded key frame to the content server (108, 408, 508), wherein the content server (108, 408, 508) is configured to provide at least some of the trick mode data to a second media device, wherein to identify the plurality of key frames, the processor is further configured to select the plurality of key frames (206, 412) from the key frames included in the media content (104, 404, 504) at predetermined time intervals, and wherein to convert the plurality of key frames (206, 412), the processor is further configured to reduce a size of the plurality of key frames (206, 412).
7. The system (100, 400, 500) of claim 6, wherein the plurality of key frames (206, 412) from the media content (104, 404, 504) includes a key frame that forms a complete image in the media content (104, 404, 504).
8. The system (100, 400, 500) of claim 6, wherein the media content (104, 404, 504) is streaming media content, and the streaming media content is streamed from the content server (108, 408, 508) over a network as the streaming media content is displayed using the media device (102, 402, 502).
9. The system (100, 400, 500) of claim 6, wherein the content server (108, 408, 508) is configured to provide at least some of the trick mode data to the second media device when the second media device requests the trick mode operation.
10. The system (100, 400, 500) of claim 6, wherein the processor is further configured to: pause the media content (104, 404, 504); and generate the trick mode data while the media content (104, 404, 504) is paused.
11. The system (100, 400, 500) of claim 10, wherein the processor is further configured to: store the media content (104, 404, 504) while the media content (104, 404, 504) is paused in one or more memories coupled to the media processor, wherein the network interface continues to receive the media content (104, 404, 504) on the media device (102, 402, 502) while the media content (104, 404, 504) is paused; and identify a key frame for inclusion into the trick mode data from the stored media content.