System and method for filtering supplemental content of an electronic book
Selecting and searching for supplementary content related to e-book text on e-book devices through media guide applications solves the problem that users in the prior art find other content related to e-books, achieving convenient content access and improved user experience.
Patent Information
- Application Number
- CN201880074991.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2017-11-20
- Filing Date
- 2018-11-19
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2039-10-01
AI Technical Summary
Existing e-book devices are difficult to interact with users effectively and provide other content related to e-book text, making it difficult for users to find content of interest or related when looking for related content.
Through the Media Guide app, users can select a portion of the e-book text on an electronic device, generate overlay classes to highlight the selected text section, and build queries to search for supplementary content related to e-books by parsing keywords in the text section.
It realizes convenient access to supplementary content related to e-books, such as movie adaptation, book reviews, video editing, etc. on e-book devices, improving users' reading experience and reducing the difficulties for users when searching for related content.
Smart Images

Figure HDA0002499689350000011 
Figure HDA0002499689350000021 
Figure HDA0002499689350000031
Abstract
Description
Background Art
[0001] There are many types of devices that can display e-book data for readers. Some of these devices can also display other types of media data. In some e-book devices, readers may be able to interact with the content of the book in a limited way. For example, readers may be able to search for the definition of a term in the book in a dictionary. In another example, readers can search for terms in the text, and highlight the text and comment on the text. This type of interaction is limited to the content of the text in the e-book. There is no mechanism for linking the e-book text with other related content. However, readers may wish to find other content related to the text to enhance the reader's reading experience. If a user wishes to find other content related to the e-book, the user will need to perform a search for the content, and the search results may be a large amount or irrelevant, because it may be difficult to find content that is of interest to the user or related to the e-book, particularly related to a part of the book that the reader is reading. Summary of the invention
[0002] Therefore, systems and methods for providing supplementary content accompanying an electronic book ("ebook") are described. An ebook user can read a book on an electronic device. There are multiple ways to view an ebook. For example, a dedicated ebook reader, such as a Kindle, Nook, or Fire tablet, can be used to read an ebook. There are also ebook software, such as iBooks, Kindle, OverDrive, CloudLibrary, etc., which can be used on a tablet or portable device to read an ebook. While a reader is reading an ebook, the reader may wish to obtain content related to the ebook. For example, the reader may wish to obtain annotations, character information, or other detailed information related to the book. Some readers may wish to view other related content, such as movie adaptations, friend's book reviews, video clips about the text, or other content. Such related content can be considered as supplementary content to an ebook. The supplementary content can be viewed on the same device that the reader is using, or shared with other devices. For example, a reader using a tablet may be sitting in their living room and may wish to activate a related movie or television show on a television screen. In another example, a reader using a tablet computer may read an e-book and want to share the experience with a family member or friend, and may search for media related to the e-book to display on another device of another person. In order to find such supplementary content, the user may interact with the text of the e-book to obtain the supplementary content. In some scenarios, the interaction with the text of the e-book may use a media guidance application to create a search query to search for supplementary content. In some examples, selectable options for supplementary content may be included in the text displayed by the e-book or included in the displayed page of the e-book. In another example, the supplementary content may also be identified by the media guidance application using information in the e-book file. These examples may be combined in the e-book text display screen to present different ways of accessing content related to the e-book in the same screen.
[0003] In an example, a user can select a portion of text in an e-book displayed on a user device. The selection of the portion of text can be input using a touch screen on the display device or using other user input techniques (such as using a mouse, ball, scroll wheel, etc.). The selected portion can be received by the user device on which the e-book is displayed, or alternatively, by a user device located away from the e-book tablet computer. The user device can receive such input from the e-book tablet computer through communication, such as through a home network (e.g., LAN), or via a data or cellular connection, or via the Internet. By generating an overlay class for the portion of text, the selected portion of the text can be identified or highlighted for the user so that it is visible to the user or reader.
[0004] The user device can parse the received text portion to determine the keywords in the text portion. The keywords can be one or more actual terms contained in the text portion. In general, any term in the selected text can be a keyword. Some terms can be determined to have greater relevance as keywords in the search. Such terms can be nouns rather than adjectives and verbs. Such terms can also be identified by comparing the terms in the selected text with the abstracts, notes or metadata about the book that may be located in the e-book manifest file. For example, some books may have a tagline associated with a reference source and may also have some associated media items. In some scenarios, the selected text can be identified in a unique way in the display so that the reader can know that there is supplementary content associated with the text. When such text is selected, the media guidance application running on the e-book device can identify the relevant supplementary content to be delivered to the device. In some examples, the media guidance application can retrieve the association between the text and the supplementary content in the e-book by checking the metadata or manifest file of the e-book. In other examples, the media guidance application can retrieve the supplementary content information from a media database that can store the association between the e-book and the supplementary content. In another example, the media guidance application may examine both sources and select the best or most relevant supplemental content item for display to the reader based on, for example, the reader's user profile, device history, media access availability, popularity of the supplemental content, strength of relevance of the supplemental content, or other criteria.
[0005] Many e-book files are stored in the EPUB file format, which is a technical standard file format for digital publications. Other file formats are also used for e-books, such as PDF. Generally speaking, the EPUB file format includes detailed information about the e-book, which can be in the manifest file of the e-book. The manifest file of the book can be retrieved by the media guidance application at the user device, and can indicate information such as the title of the e-book and the chapter of the e-book from which the portion of the text is selected. Automatic selection can be performed by the media guidance application on the title obtained from the manifest file, and the title can be used as the first condition. The chapter of the e-book can be obtained from the manifest file and automatically selected as the second condition. In some scenarios, the media guidance application can search a database of stored e-books and related content links, and then filter the relevant results using the manifest details of the e-book.
[0006] These conditions (i.e., first condition-title, second condition-chapter) and keywords obtained from the selected portion of the text can be used to generate a query for supplementary content related to the electronic book portion. The query can be sent from the user device to a remote database, such as a media database, to search for supplementary content items that match the query (i.e., keywords, first condition and second condition). Then, the matching supplementary content items can be sent to the media guidance application and displayed by the media guidance application at the user device. In the example, an electronic book reader can read a version of "Beauty and the Beast". "Beauty and the Beast" has many different book versions and adaptations. There are also TV series, movies, cartoons, animated movies, songs, music videos and other media inspired by the original story. If a reader of "Beauty and the Beast" is interested in finding related content related to the book, the reader can select a portion of the text of the "Beauty and the Beast" electronic book to generate a search. Such a search can also include conditions in the electronic book manifest file, including the title of the book and the chapters of the book. Simply searching for keywords in the text may lead to many random results. For example, in "Beauty and the Beast," a simple search for the tagline "be our guest" may result in results matching "guest." Such results may not be relevant to the reader. For a reader who may be reading "Beauty and the Beast" and sees the phrase "be our guest," the song from the movie may be recalled and the reader may wish to watch the music video or movie clip containing this song.
[0007] Adding the book title to the search will help put the search in context. Additionally, for episodic or multi-part media, using chapter or location information can outline a point in the story's development to find more relevant results. In some examples, knowing that the tagline "be our guest" is in reviews and comments about the "Beauty and the Beast" media, the media guidance application can identify supplemental content for the tagline and store it in an e-book database that can provide information to e-book readers, so that the use of the tagline in the e-book can be displayed in a manner that indicates the presence of supplemental content. When such text is selected, the media guidance application can receive the selection, and the media guidance application will then consult the e-book database or e-book metadata file to identify and retrieve relevant supplemental content.
[0008] Additional criteria for searching may also be included in the search. For example, a third criterion related to the selected portion of the text may be identified in the manifest file of the electronic book, including page number, line number, paragraph number, scene, electronic bookmark, movie, movie version. Additional criteria and combinations of criteria may also be used to form a query for supplemental content. For searches automatically performed by the media guidance application, the manifest file criteria may be used to focus on selecting specific supplemental content items that are most relevant to the portion of the text in the electronic book.
[0009] User preference information can also be used to shape search and filter results. For example, for a reader with a media guide user profile that includes parody, cartoons, and comedy, when such a reader selects a portion of text from an e-book, the preference profile can change the results. For example, for a reader of "Beauty and the Beast," when selecting the tagline "be our guest," the reader can see a list of results that includes the Simpsons episode that includes Mr. Burn's parody song "See My Vest."
[0010] In some scenarios, the supplementary content identified in the search can be shared with a second user device. For example, a reader may read an e-book on a tablet or portable device, and may wish to view some content related to the book, such as a movie adaptation of the book. The reader may want to watch the movie on a larger screen (such as a TV), or may wish to share the movie with a second device (which may be the reader's own device, or the device of a friend or family member). The supplementary content displayed on the user device can be configured to be displayed with an optional button that allows the user to share the supplementary content with another device. When the user selects the button, the media guidance application will receive the selection and cause the supplementary content to be displayed on the second device. Before the supplementary content is displayed on the second device, the media guidance application can perform an optional determination to ensure that the supplementary content item can be displayed on the second device. For example, the second device may have certain media subscription restrictions, age and content controls, or other restrictions for displaying supplementary content. In this case, the user can be prompted to confirm the accessibility or applicability of the supplementary content.
[0011] In some scenarios, the e-book can be displayed in a way that makes it clear that there is relevant supplementary content. For example, a sentence or phrase in an e-book can be a slogan in a movie adaptation of the book. For example, in "Beauty and the Beast", the slogan "be our guest" can be displayed in different ways in the e-book. In this example, the sentence with the slogan can be highlighted in a way that shows that it has associated supplementary content. Each instance of the highlighted phrase or term can be shown in different ways, which can indicate the type or source of the supplementary content. For example, supplementary content as a video clip can be shown with related text displayed in one way, and supplementary content as a movie can be depicted by related text shown in another way. Other types of imitation or social commentary content can be depicted in other ways. The slogan "be our guest" can be associated with the "Beauty and the Beast" movie, the music video of the song "Be our Guest", the cartoon showing the song "Be our Guest", the episode of one of the "Beauty and the Beast" TV series related to the scene, or other related media in the media database. A tagline in an e-book may be associated with different items in a media database depending on the location of the tagline in the e-book text. For example, an early use of "be our guest" may be associated with a portion of a movie or a video clip, while a later use of "be our guest" may be associated with a rerun video, a television episode, or a scene from the live-action version of "Beauty and the Beast," etc. The metadata for an e-book file may include references between the e-book text and supplemental content, or between the e-book text and an e-book database source for finding links to supplemental content. The media guidance application may update such a database to provide the best and most relevant supplemental content items.
[0012] The sentence can be visually highlighted using an overlay class for a sentence to show that there is relevant supplementary content. In another example, a button or selectable indicator can be included in the e-book display, which can be selected to obtain the supplementary content of the e-book related to a part of the e-book displayed to the reader. As the reader gradually reads the e-book, depending on the page the reader is viewing or reading, this type of supplementary content button can lead to different supplementary content items. For example, a portion of the text in the early stage of "Beauty and the Beast" may be related to many adaptations of "Beauty and the Beast" - movies, television, live-action performances, music videos, but the text position in the later stage may have different associated media items, because the movie or TV series may have omitted the reference to some parts of the book "Beauty and the Beast". Detailed information about the relationship between the progress in the book can be found in the manifest file of the e-book and is used to associate the associated media items in the remote media database.
[0013] When creating a query to search for supplemental content, the criteria obtained from the manifest file may be important because it may be relevant to the progress of the electronic book. This may be relevant for a book that is part of a series of books and / or may be adapted into episodes of multiple movies or television series. Thus, when chapter information for a selected portion of the text is obtained from the manifest file, the chapter information may be relevant to the last page that the user has viewed while progressively reading the book.
[0014] When the supplemental content is displayed on the user device, the user may wish to easily return to the e-book. When the user selects a portion of the text to initiate a search for the supplemental content, the media guidance application can capture the location of the text portion in the e-book file, create a bookmark for the page, and store the bookmark in association with the user of the e-book file. The e-book bookmark can be stored in a cache on the e-book reading device and / or in a database of the user. Such a database may include user reading history information and may access user profile information. In order to facilitate the user to return to the e-book, the supplemental content can be displayed together with a selectable option to return to the e-book. In particular, return to the point in the e-book where the user selected the text portion for finding the supplemental content. The e-book bookmark can be used to identify the location. Or, in some scenarios, the user may wish to return to the last point in the book that the reader has read.
[0015] In another example, a search query can be used to find supplementary content for an e-book, which then uses information in the e-book file, particularly the information in the manifest file of the e-book, to filter the search query. In an embodiment, a first user input is received at a user device to select a portion of text in an e-book. The user can select a portion of the text using any suitable technique, such as by touching the portion of text on a touch screen tablet, or by using a mouse, scroll wheel, keyboard or other input device on a reading device. In some scenarios, a highlight in the e-book display (e.g., an EPUB overlay class for the text portion) can be used to identify the portion of text selected by the user. The selected portion of text can be parsed at the user device using a media guidance application to determine keywords in the text portion. The media guidance application in the user device can be used to control the circuit system and analyze the terms in the selected portion of text to determine one or more keywords. For example, some short words (such as text function words) may not be important words to be included in the search, and the terms contained in the metadata or manifest file of the e-book can be given a higher priority to be used as keywords. Alternatively, some nouns, verbs or other terms may be more suitable for searching.
[0016] A query may be generated at a user device using a media guidance application to search for supplemental content based on the determined keywords. The keywords in the query may be sent to a remote database over a network using the media guidance application to search for supplemental content. The remote database may be any media database, and searches may be performed simultaneously in more than one media database to obtain search results. Search results matching the query may be received from the remote database at the user device.
[0017] The media guidance application can filter the search results to improve the quality of the results and use the information in the electronic book file to reduce the number of search results. The user device can retrieve the manifest file of the electronic book. The manifest file includes information about the electronic book, for example, including the title and chapter of the text portion selected to generate the search query. The user device can automatically select that information, namely the title and chapter, from the manifest file as a condition for filtering the search results. The user device can filter the search results based on these conditions. The filter can, for example, remove search results that are not related to the title and / or chapter, leaving search results that have some match or connection with the title and / or chapter. After filtering the search results based on the conditions, the media guidance application can generate a display of the search results that match the conditions. The media guidance application can also obtain additional types of conditions from the manifest file, which can also be used to filter the search results. Some of these conditions can be the page number, line number, paragraph number, scene, electronic bookmark, or movie version of the electronic book. Automatically selecting the conditions using the manifest file can be performed using the location of the selected text. In some scenarios, the conditions can be selected using information about the reader's location. For example, the chapter condition can be selected based on the user's progress using pages (such as the page last visited by the reader).
[0018] In an example, a page or chapter in a manifest file may include percentage information of progress toward completion of the e-book. A page or chapter in a manifest file may also be associated with metadata including chapter summary information and keywords that may be used to enhance searches for related supplemental content. Such metadata information in a chapter summary may also be used to compare with metadata for media items in a media database. For example, metadata for an episode of the television series "Beauty and the Beast" may include closed caption text that may be searched to find closed caption terms that match keywords or selected portions of text. In another example, metadata for a movie may include slogans and keywords that may match search query terms.
[0019] In some scenarios, the media guidance application may receive a selection of a portion of the electronic book text in a display screen and generate supplemental content to automatically display on the user device. In other scenarios, the media guidance application may receive a selection of a portion of the electronic book text and may display search results for more than one related supplemental content item for the user to select.
[0020] The user may select one of the search results in the display, and the media guidance application will generate a display of supplemental content items corresponding to the selected search result. For example, the user may select a movie or television series from a list of search results, and the media guidance application will generate a display of the selected media item by requesting the selected media item from a media source.
[0021] In some scenarios, the option of supplementary content and sharing the content with a second user device may be displayed. Such an option may be included in the display of the supplementary content and / or included with the search results. This option may also be provided when a user initiates a query or request for supplementary content. If the user selects the option for sharing the supplementary content with another user device, the media guidance application may then share and display the supplementary content on another user device. Before sharing the supplementary content to another device, the media guidance application may check that the supplementary content can be displayed on another device. For example, the second device may be a child's device or have some content access restrictions. In this case, the media guidance application may ensure that the supplementary content is suitable and meets the requirements or controls set for the second device. In another case, a subscription requirement may be required to access the supplementary content. If it is determined that the second device cannot access certain media sources, then if the subscriber is restricted, the supplementary content cannot be displayed on the second device. Alternatively, the user may be shown options to repair the restrictions, such as by accessing subscriber-restricted sources, abandoning access restrictions, etc.
[0022] In some examples, the availability of supplemental content can be shown in the e-book display. In such an example, sentences in the e-book related to the supplemental content can be highlighted or shown in a visible manner. The highlighting can be achieved using an EPUB overlay class for the sentence used as an indicator in the overlay class for the supplemental content. In another example, the e-book text can be shown within the e-book display with a selectable indicator that, when selected, causes the supplemental content of the e-book to be displayed on the user device.
[0023] The supplemental content may be displayed on a reading device that the user is using to view the e-book. Since the reader may wish to easily return to the e-book after viewing the supplemental content, the supplemental content display may include a selectable option to return to the e-book text. In some scenarios, the selectable option will allow the reader to return to the selected portion of text used to generate the search query. In other scenarios, the selectable option, when selected, will return the reader to the last page the reader visited in the e-book.
[0024] In some scenarios, when a user accesses an e-book file, supplementary content can be searched and identified. For example, a user can access an e-book file by purchasing an e-book from an e-book store, borrowing an e-book from a friend or library or other source. The e-book file of the e-book can be delivered to a suitable device of the user. The media guidance application can run on the user's device and can access the e-book file and user preference information. In some examples, when the file is delivered, accessed or otherwise associated with the user, the media guidance application can perform a search for supplementary content of the e-book. For example, if a user is tagged for a book in social media, the tag can be detected by the media guidance application, and this e-book association can enable the media guidance to perform a search for supplementary content for the user. In another example, when the user keeps the e-book in the user's library account, the media guidance application can search for supplementary content for the user. In another example, the media guidance application can perform a search for supplementary content of the e-book when the user purchases the e-book or downloads it to the device, or performs other actions that can be detected by the media guidance application to connect the e-book to the user.
[0025] When the media guidance application performs a search for supplementary content on an e-book, the media guidance application may use keywords in the e-book file to form a search query for the supplementary content. For example, the media guidance application may use keywords in a chapter summary or annotations in the e-book file. In some examples, the keywords may be obtained from metadata associated with the e-book in the e-book file. In other examples, the query terms may also include keywords or conditions in the manifest file of the e-book. In some examples, keywords may be obtained from a third-party database associated with the book (e.g., a book review database, a book blog, book seller information, or other sources). The media guidance application may search for supplementary content associated with the e-book in a media source. Links to supplementary content items identified in the search may be stored in association with relevant portions of the book text in the e-book file, such as in the metadata of the e-book. When presenting an e-book for display in a device, a control circuit system for the e-book may retrieve metadata information for the e-book and display the e-book text in a manner that makes it clear that portions of the e-book text have associated supplementary content that can be accessed by a reader. For example, a text portion in a book may include a slogan that may be displayed in a unique manner so that the user may know that there is associated content. For example, in the book "Beauty and the Beast," the tagline "be our guest" may be displayed in a unique format so that the user knows it may be selected to obtain supplemental content, such as a music video performing songs from the film adaptation of "Beauty and the Beast."
[0026] In general, the media guidance application may periodically update the search for supplemental content so that the links displayed in the e-book text are timely and relevant. In some scenarios, the media guidance application will use user preference information to identify appropriate supplemental content for the user. Thus, an e-book file stored on a device accessed by more than one user (e.g., a family tablet) may be displayed with different highlighted portions or links to different types of related supplemental content based on the reader's user profile and content access restrictions for the reader.
[0027] In some scenarios, a media guidance application can perform a search for supplemental content for any e-book file, without having to specifically focus on the user to build a database that connects text in the e-book file to the supplemental content. Although identifying these supplemental content links for an e-book without limiting the focus to a specific book or a specific user may be somewhat wasteful in processing and storage capabilities, the media guidance application can access this information to quickly provide the supplemental content links to the user. Such a database can be regularly updated with links to the supplemental content. When a user accesses an e-book file, the media guidance application can use the database information for the e-book to add a link in the display of the e-book file. Ideally, in this scenario, the media guidance application will refine the selection of the supplemental content link in the link to the supplemental content shown in the reader's e-book display based on the reader's user profile.
[0028] In some examples, the text of an electronic book may be displayed in more than one manner for obtaining supplemental content. For example, the text of an electronic book may include selectable options on a page that may lead to supplemental content that is typically associated with the displayed page. In the same display screen, the electronic book text may have certain words or images displayed in the text in a unique manner that implies that there is associated supplemental content. When these unique words or images are selected, the media guidance application may retrieve the supplemental content associated with the words or images. In the same display screen, the reader may select terms in the text and use them to form the basis for a query for supplemental content. The selection of text terms may enable the media guidance application to identify keywords in the selected text, and may also identify location and book title information from the manifest file of the electronic book, and form a search query for supplemental content. For the reader, searching for content in this manner may be time consuming, but the reader may focus on searches related to the selected terms.
[0029] It should be noted that the above-described systems, methods, apparatuses and / or aspects may be applied to or used according to other systems, methods, apparatuses and / or aspects described in the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The above and other objects and advantages of the present disclosure will become apparent upon consideration of the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals refer to like parts throughout, and wherein:
[0031] Figure 1-4 shows an illustrative example of a display screen for an electronic book according to some embodiments of the present disclosure;
[0032] Figure 5 shows an illustrative example of search results in a display screen according to some embodiments of the present disclosure;
[0033] Figure 6 shows an illustrative example of display of supplemental content according to some embodiments of the present disclosure;
[0034] Figure 7 An illustrative example of a display screen of an electronic book and a second device showing supplemental content according to some embodiments of the present disclosure;
[0035] Figure 8 is a block diagram of an electronic book data file according to some embodiments of the present disclosure;
[0036] Figure 9-10 shows other illustrative examples of display screens generated by a media guidance application according to some embodiments of the present disclosure;
[0037] Fig.11 is a block diagram of an illustrative user equipment device according to some embodiments of the present disclosure;
[0038] Fig.12 is a block diagram of an illustrative media system according to some embodiments of the present disclosure;
[0039] Figure 13-14 is a flow chart of an illustrative process for searching for supplemental content for an electronic book according to some embodiments of the present disclosure;
[0040] Fig.15 is a flow chart of an illustrative process for generating a list of supplemental content for an electronic book according to some embodiments of the present disclosure; and
[0041] Figure 16-17 is a flow chart of an illustrative process for searching for supplemental content for an electronic book according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0042] Systems and methods for searching for supplementary content for an electronic book or ebook are described. Reading books on electronic devices is now common. Today, ebook readers are generally no different than electronic tablets in their ability to run software applications and display different types of media. Once upon a time, reading was that simple. But now, as media has gradually permeated electronic devices, readers can easily look up terms in a dictionary by clicking on the terms in the text of an ebook and find book reviews about the book. Readers may want to enhance their reading experience by accessing related or supplementary content for an ebook. For example, readers may want to watch a movie adaptation of an ebook, watch a clip from the movie adaptation, view a music video of a song with a slogan that appears in the ebook. Readers may also want to share the ebook experience by, for example, sharing the movie adaptation to the screen of a friend or family member. In another example, a reader may want to hear the score of the movie adaptation so that the reader has an audio experience of the book that surrounds it.
[0043] Conventional e-book display screen Figure 1 As shown, the electronic book device 100 includes an electronic book display for the "Beauty and the Beast" picture book, which shows the title 110, author 120, page number 130 and text 140 of the electronic book. The arrangement in the screen is only illustrative, and some of the elements shown may be omitted so that only the text 140 and the title 110 or some combination of book elements are shown. In addition, the book may include a background image and picture of the book that may be related to the text 140.
[0044] Figure 2 It is shown in Figure 1200 of the same book shown in FIG. 210 . For example, title 210 , author 220 , and page 230 information are shown in the e-book display 200 . The text 240 of the e-book is shown with some additional enhancement elements. For example, the phrase "The Beast" is displayed in bold. Box 250 highlights the phrase "be our guest" in the text 240 that has been selected by the reader. A selectable option 260 for related content is also shown. The phrase "The Beast" is displayed in bold to indicate its importance and depict the source or type of associated related content that the media guidance application has identified. The highlighted phrases or terms in the e-book can be depicted in a variety of ways so that the user can see that different types of media can be associated with the phrase. For example, different colors or text styles can be used to indicate that there may be related movies, television shows, video clips, news articles, blog reviews, social network channels, user-generated video reviews, etc. The highlighted phrases can be significant for different reasons. In some examples, a highlighted phrase may indicate that it has some related content, and if the phrase is selected, some additional content about the phrase may be accessed. Words shown highlighted in the e-book file may be selected to be displayed in an appropriate manner by the media guidance application using information about the text in the e-book manifest file and using metadata for the e-book. For example, the media guidance application may retrieve detailed information about supplemental content for the e-book from a media database and identify terms to be highlighted in the e-book by matching the supplemental content items with the e-book text information in the e-book manifest file.
[0045] The supplemental content associated with the highlighted terms in the electronic book text display can be any type of media content, such as a movie, an image or information about a character, a definition or annotation about a phrase, or other information. The highlighted phrase 250 can also indicate the importance of the phrase within the highlight. For example, the highlight can be created using the overlay class of the EPUB file.
[0046] Highlighted phrase 250 may also be used to represent text that has been highlighted by a reader to generate a query for supplemental content. The media guidance application may receive a user selection of portion 250 of text using a user input technique such as a touch screen or keyboard. The selection of portion 250 may be received by the media guidance application and used to form the basis of a query to search for content related to the electronic book, particularly the selected portion of the electronic book.
[0047] Option 260 can be another way to access related content of an e-book. In response to receiving a user's selection of option 260 from certain pages, a media guidance application can be instructed to create a query for supplementary content, which includes detailed information about the location of option 260 within the e-book display. For example, in a book adapted as a series of television series, a manifest file for the e-book text may include page numbers or chapter numbers, which may indicate the reader's progress in the book, which may be related to a specific television series in the series of television series. A specific episode can be identified as related supplementary content in several ways. For example, metadata of a series of episodes can be searched to find descriptive information that matches a keyword. In another example, closed caption data of a series of episodes can be used to find instances of using keywords. In another example, the percentage of completed e-book text that can be obtained from the manifest file can be roughly related to the progress of a series of episodes. In yet another example, user-generated reviews associated with a series of television episodes can be searched to find terms that match keywords and chapter progress. Selecting option 260 from one page of the book can lead to one episode, while selecting option 260 from another page of the book can lead to another episode of the television series. In another example, selecting option 260 may result in displaying more than one supplemental content item. In some examples, selectable option 260 may link to specific supplemental content identified by the media guidance application as being relevant to the e-book page being displayed to the reader. The media guidance application may store the supplemental content link in the metadata of the e-book file or in a remote e-book database. Such links may be periodically updated by the media guidance application.
[0048] Figure 3 and Figure 4 Also an illustrative depiction of an electronic book display. Figure 3 , the electronic book device 300 shows a display of “Beastly Kendra Chronicles,” which is based on the story of “Beauty and the Beast,” and the display includes a book title 310 , an author 320 , page numbers 330 , and electronic book text 340 . Figure 4 The same e-book text is shown in FIG, with an additional feature for searching for supplementary content related to the e-book text. Figure 4, the e-book display 400 includes a title 410, an author 420, a page number 430, a chapter 435, and an e-book text 440. For text in the e-book that has been selected by the reader, a highlighted portion 450 of the text 440 is shown. The selection of portion 450 can be received by the reader or a media guidance application at the electronic device and used to form the basis of a query for searching for content related to the e-book (particularly related to the selected portion of the e-book). Supplementary content related to the e-book can also be obtained by selecting option 460 and by selecting certain text shown in a unique manner in the e-book display, for example, by selecting "The Beast" that is highlighted to show that it has some related content. "The Beast" can be highlighted in a unique manner to indicate that it has supplementary content from a certain source or a specific type, such as a movie or video clip, or a social network channel or user-generated review, etc. Selecting option 460 from a page of the book or a certain chapter of the book can result in different related content, depending on the location of the selection option 460 within the e-book. Information about the progress of browsing the text can be discerned from the manifest file of the electronic book file and used to find appropriate supplemental content.
[0049] The selected portion of the text 250 ( Figure 2 ) and 450( Figure 4 ) may include one or more terms from the e-book. The selected terms may be parsed by a media guidance application running on the e-book reader to find one or more keywords to use in a search query for supplemental content. For example, Figure 4 The selected portion of 450, "there was my beastface once again", can produce the keywords of "beast face", which are nouns, while the function word "my" can be discarded from the search query because it is a linguistic function word that may have too many matches in the search. Similarly, the terms "once" and "again" are adverbs and can also be discarded from the search query because they do not produce useful search results. Such a query can be performed by the media guidance application when the selected terms are received from the user, or when the media guidance application parses the e-book text as a whole to identify links between the e-book and the supplemental content.
[0050] When, for example, by using button 260 ( Figure 2 ) or 460( Figure 4 ) to receive a selection of an option for related content, or by selecting a portion 250 or 450 of the text (respectively Figure 2 and Figure 4), or by selecting a portion of text designated as having relevant content, a remote database of media content may be searched for the supplemental content or a predefined link to the supplemental content. The remote database may be an electronic book or a media database that is accessible from the media guidance application via a home network (e.g., a LAN) or the Internet. A search may be performed by the media guidance application in one or more media databases to obtain search results. The search query may be created using the selected text and information about the electronic book, particularly the location within the electronic book.
[0051] A manifest file for an e-book can be received by a media guidance application running on a user device and can include all of the e-book text as well as additional metadata and layout information for the e-book. A common file type is an EPUB file that sets standards for file content and manifest file content. Other types of e-book file types may have similar standards and requirements and may also be used to perform the features and functions described herein. The manifest file information can be used to form a search query, and in particular, the location information of the selected text used to initiate the search query can be used in the search query. For example, the chapter or location of the e-book page where the text portion is located can be added to the search query, or used to filter the search results so that the results focus on a specific point in the progress of the e-book story. In another example, the title of the e-book can be obtained from the manifest title to add it to the search query so that the search query focuses on the context of the book. Other detailed information about the e-book can also be obtained from the manifest file to add to the search query, or to filter the search results.
[0052] The search results for the search query can produce a single relevant supplemental content item, which can then be automatically displayed on the user device by the media guidance application. In some examples, multiple search results for the search query can be presented, such as Figure 5 , which depicts a user device 500 and five search results 510, 520, 530, 540, and 550. The user device 500 may be a previously used electronic book reader (e.g., 100, 200, 300, or 400 ( Figure 1-4 )) of the same user device. Alternatively, the search results may be presented on another separate user device. Search results 510, 520, 530, and 540, all of which are related to "Beauty and the Beast", are different versions of movies created in different years. For the Figure 4) (i.e., "Beastly Kendra Chronicles"), search results 530 for the movie "Beastly" may be particularly relevant, or search results 520 for episodes of the television series "Beauty and the Beast" may be particularly relevant. Figure 2 ) may produce search result 550 for "Beauty and the Beast" (a 1984 cartoon) or the more recent 2017 Disney work in search result 510. Each of these search results may be selected and ranked in a list using version information and other details in the e-book's manifest file. Figure 5 The results are shown in chronological order, but the results can be displayed according to relevance, user preference, or other sorting.
[0053] Figure 2 The e-book shown in (a children's version of the book "Beauty and the Beast") and Figure 4 Each of the electronic books shown in (loosely based on the young adult book "Beauty and the Beast") may have manifest file data and metadata that references information about the book that may be relevant when associating supplemental content. For example, a young adult book may include an age group category that indicates that this is not a children's book. Figure 4 A search for the content of "Beastly Kendra Chronicles" in the media guidance application may not produce matching results for the cartoon adaptation of "Beauty and the Beast". Of course, if the media guidance application determines that the reader's user profile has a history of watching cartoons, such cartoon adaptations may be included. A search initiated within the electronic book text of "Beastly Kendra Chronicles" may also include results related to "Beauty and the Beast" because the metadata for the book will include that the book is a loose adaptation of an old story.
[0054] In another example, a children's book may also have an age group category that indicates that this is a children's book. Thus, a search for supplemental content derived from a children's book version will not yield search results for the television series "Beauty and the Beast" with a TV rating of TV-14 and parental guidance content, even though the children's book has the same title as the television series. In some scenarios, if the user profile of the reader of the children's book contains some adult material, then the television show episode may be included in the results list.
[0055] For those from Figure 2 or Figure 4 A search of the text of the electronic book may provide search results and supplemental content with options for viewing on the parent's or child's device, such that, for example, if a child is reading a children's version of "Beauty and the Beast," the parent may wish to view episodes of "The Beastly Kendra Chronicles" that are relevant to the progress in the book they just read with their child. In this scenario, the media guidance application would use the manifest file to determine the reader's position in the electronic book text using the selected text in the electronic book text and search the digital media database for supplemental content and narrow the focus of the results to episodes that overlap with the progress of the story. Finding the appropriate episode based on the timeline or progress of the story may be determined by using the closed captioning metadata of the episode and matching it with keywords or surrounding text in the chapters or chapter summaries in the electronic book manifest file, using user-generated comments (such as episode summaries) and matching such comments with chapter summaries, or other techniques, using the percentage of the book that has been completed.
[0056] The media guidance application receives a user selection of a search result, such as search result 510, which results in the supplemental content being delivered to the user device, such as Figure 6 as shown in . Figure 6 A user device 600 is shown, which shows that Figure 5 610 . In some scenarios, the display may include an option 620 to return to the e-book file. Selection of option 620 will cause the media guidance application to return the reader's display to the e-book text. In some examples, selection of option 620 will cause the media guidance application to return the reader to the display of the selected portion of the text that was used to generate the query for the supplemental content. In another example, selection of option 620 will cause the media guidance application to generate a display of the last page visited by the reader. Generally speaking, when the reader returns to the e-book, the visual cues within the e-book text for the supplemental content may be different so that the user knows that they have selected or viewed such supplemental content. When the reader accesses supplemental content, the access may be recorded by the media guidance application in the user history, and the user history may be used by the media guidance application to generate a display of links to such content in different ways.
[0057] If option 620 is selected, go to Figure 7, the reader can return to the text of the e-book in device 705 and continue reading the e-book text 710. Because the reader has already viewed the supplementary content, the visual cue of the associated supplementary content can be displayed in a different way—for example, "The Beast" is displayed in italics. The user can have the option of sharing the supplementary content with a second device 715 to display the supplementary content 720 on the second device.
[0058] An example of the electronic book data file 800 is shown in Figure 8 . As shown, the data file may contain many containers of detailed information about the e-book. The manifest file may include layout information for the content of the e-book file. In some examples, the manifest file can be used to reference the e-book data as a whole in any container. The e-book data file 800 may include identifier information 810. The identifier information 810 may include an ISBN number for the book or other identifier. The metadata 820 of the book file 800 may include data about the book file data, and may include any number or type of detailed information about the book file. The metadata 820 of the file may include reader notes, publisher notes, public reviews, etc. The metadata 820 may also include other detailed information about the book 825, such as the title, the description of the book, the source of the book, the relationship of the book to other books in a series of books, or to film adaptations, comic book adaptations, etc. The metadata 820 may also include book coverage information and content rights. The media guidance application may update the content of the metadata 820 to include, for example, links to supplementary content identified for the e-book, in particular, links to supplementary content identified for a specific portion of the e-book. The media guidance application may periodically update such metadata to include updated links and most relevant links based on user profiles, user access history, media subscriptions, etc. Manifest file data 830 may include detailed information about the arrangement of the electronic book file data and may be used to identify data in the data file 800 that is relevant to the display screen of the electronic book. Manifest file 830 includes detailed information 835 about chapters, introductions, postscripts of the book, and other content parts of the book. Spine 840 data may include information about the spine. Other detailed information about data file 800 may also be stored in database 850. For example, user-generated data may be stored in database 850 and may be available to other readers of the electronic book. An example of user-generated data may be highlighting and annotations to a text portion. In another example, a reader may identify supplemental content associated with a text portion, and may highlight a text portion in the book and link to the supplemental content and the reader. The link may be stored in database 850.
[0059] The e-book interface on the user device can be similar to the interface of other types of media accessed on the user device. For example, a media guidance application can provide a way to search and deliver media content in the same way as it provides supplementary content (such as movie adaptations of books).
[0060] In any given content delivery system, the amount of content available to users can be large. Therefore, many users desire media guidance in the form of an interface that allows users to efficiently navigate content selections and easily identify content they may desire. Applications that provide such guidance are referred to herein as interactive media guidance applications, or sometimes as media guidance applications or guidance applications.
[0061] Interactive media guide applications can take various forms based on the content of the guides they provide. A typical type of media guide application is an interactive television program guide. An interactive television program guide (sometimes referred to as an electronic program guide) is a well-known guide application that, among other things, particularly allows users to navigate and locate in a variety of types of content or media assets. An interactive media guide application can generate a graphical user interface screen, which enables users to navigate, locate and select between content. As mentioned herein, the terms "media assets" and "content" should be understood to mean electronically consumable user assets, such as television programs, and pay-per-view programs, on-demand programs (such as in video-on-demand (VOD) systems), Internet content (e.g., streaming content, downloadable content, webcast (Webcast) etc.), video clips, audio, content information, pictures, rotating images, documents, playlists, websites, articles, books, electronic books, blogs, chat sessions, social media, applications, games and / or any other media or multimedia and / or combinations thereof. Guide applications also allow users to navigate and locate between content. As referred to herein, the term "multimedia" should be understood to mean content that utilizes at least two of the above different content forms (e.g., text, audio, image, video, or interactive content forms). The content can be recorded, played, displayed, or accessed by a user equipment device, but can also be part of a live performance.
[0062] The media guidance application and / or any instructions for performing any embodiment discussed herein may be encoded on a computer-readable medium. Computer-readable media include any medium capable of storing data. Computer-readable media may be transient, including but not limited to propagating electrical or electromagnetic signals, or may be non-transient, including but not limited to volatile and non-volatile computer memory or storage devices such as hard disks, floppy disks, USB drives, DVDs, CDs, media cards, register memory, processor caches, random access memory ("RAM"), and the like.
[0063] With the advent of the Internet, mobile computing, and high-speed wireless networks, users are accessing media on user equipment devices on which they would not traditionally have accessed media. As referred to herein, the phrases "user equipment device," "user equipment," "user device," "electronic device,"
[0064] "Electronic equipment", "media equipment device" or "media device" should be understood to mean any device for accessing the above content, such as a television, a smart TV, a set-top box, an integrated receiver decoder (IRD) for processing satellite television, a digital storage device, a digital media receiver (DMR), a digital media adapter (DMA), a streaming media device, a DVD player, a DVD recorder, a connected DVD, a local media server, a BLU-RAY player, a BLU-RAY recorder, a personal computer (PC), a laptop computer, an e-book reader, a tablet computer, a WebTV box, a personal computer television (PC / TV), a PC media server, a PC media center, a handheld computer, a fixed telephone, a personal digital assistant (PDA), a mobile phone, a portable video player, a portable music player, a portable game console, a smart phone or any other television equipment, computing equipment or wireless device, and / or a combination thereof. In some embodiments, the user equipment device can have a screen facing forward and a screen facing backward, multiple front screens or multiple angled screens. In some embodiments, the user equipment device can have a camera facing forward and / or a camera facing backward. On these user equipment devices, users may be able to navigate and locate the same content that is available through a television. Thus, media guidance may also be available on these devices. The guidance provided may be for content available only through a television, for content available only through one or more other types of user equipment devices, or for content available both through a television and through one or more other types of user equipment devices. The media guidance application may be provided as an online application (i.e., provided on a website) or as a standalone application or client on a user equipment device. The various devices and platforms on which the media guidance application may be implemented are described in more detail below.
[0065] One of the functions of a media guidance application is to provide media guidance data to a user. As referred to herein, the phrases "media guidance data" or "guide data" should be understood to mean any data related to content or data used in operating a guidance application. For example, guide data may include program information, guide application settings, user preferences, user profile information, media listings, media-related information (e.g., broadcast times, broadcast channels, titles, descriptions, rating information (e.g., parental control ratings, critics' ratings, etc.), genre or category information, actor information, logo data for a broadcaster or provider's logo, etc.), media formats (e.g., standard definition, high definition, 3D, etc.), on-demand information, blogs, websites, and any other type of guide data that helps a user navigate and locate desired content selections.
[0066] Figure 9-10 Illustrative display screens that may be used to provide media guidance data are shown. Figure 9-10 The display screens shown in the can be implemented on any suitable user equipment device or platform. Figure 9-10 The displays of the media guidance application are shown as full screen displays, but they may also be completely or partially overlaid on the content being displayed. The user may indicate a desire to access content information by selecting a selectable option provided in the display screen (e.g., a menu option, a list option, an icon, a hyperlink, etc.) or by pressing a dedicated button (e.g., a GUIDE button) on a remote control or other user input interface or device. In response to the user's indication, the media guidance application may provide media guidance data to the display screen organized in one of several ways, such as by time and channel in a grid, by time, by channel, by source, by content type, by category (e.g., movies, sports, news, children or other program categories), or other predefined, user-defined, or other organizational criteria.
[0067] Fig. 9An illustrative grid of a display 900 of program listings arranged by time and channel is shown, which also enables access to different types of content in a single display. Display 900 may include a grid 902 having: (1) a column 904 of channel / content type identifiers, where each channel / content type identifier (which is a cell in the column) identifies a different channel or type of content that is available; and (2) a row 906 of time identifiers, where each time identifier (which is a cell in the row) identifies a time block of a program. Grid 902 also includes cells of program listings, such as program listing 908, where each listing provides the title of a program offered on the listing's associated channel and time. Using a user input device, a user may select a program listing by moving highlight region 910. Information related to the program listing selected by highlight region 910 may be provided in program information region 912. Region 912 may include, for example, the program title, a description of the program, the time at which the program is offered (if applicable), the channel on which the program is offered (if applicable), a rating for the program, and other desired information.
[0068] In addition to providing access to linear programming (e.g., content that is scheduled to be sent to multiple user equipment devices at predetermined times and provided according to a schedule), the media guidance application also provides access to non-linear programming (e.g., content that is accessible to user equipment devices at any time and is not provided according to a schedule). Non-linear programming can include content from different content sources, including on-demand content (e.g., VOD), Internet content (e.g., streaming media, downloadable media, etc.), locally stored content (e.g., content stored on any user equipment device or other storage device as described above), or other time-independent content. On-demand content can include movies or any other content provided by a particular content provider (e.g., HBO On Demand, which provides "The Sopranos" and "Curb Your Enthusiasm"). HBOON DEMAND is a service mark owned by Time Warner, Inc., LP et al., and THE SOPRANOS and CURB YOURENTHUSIASM are trademarks owned by Home Box Office, Inc. Internet content may include web events (such as chat sessions or webcasts), or content available on-demand as streaming content or downloadable content through an Internet website or other Internet access (e.g., FTP).
[0069] Grid 902 may provide media guidance data for nonlinear programming, including on-demand listings 914, recorded content listings 916, and internet content listings 918. The display of media guidance data that combines content from different types of content sources is sometimes referred to as a "mixed media" display. Various permutations of the types of media guidance data that may be displayed, which differ from display 900, may be based on user selections or guide application definitions (e.g., displays of only recorded and broadcast listings, only on-demand and broadcast listings, and the like). As shown, lists 914, 916, and 918 are shown as spanning the entire time block displayed in grid 902 to indicate that the selection of these lists may provide access to displays dedicated to on-demand listings, recorded listings, or internet listings, respectively. In some embodiments, lists for these content types may be included directly in grid 902. Additional media guidance data may be displayed in response to a user selecting one of navigation icons 920. (Pressing arrow keys on a user input device may affect the display in a manner similar to selecting navigation icon 920.)
[0070] Display 900 may also include video area 922 and options area 926. Video area 922 may allow a user to watch and / or preview programs that are currently available, will be available, or have been available to the user. The content of video area 922 may correspond to one of the lists displayed in grid 902 or may be unrelated thereto. A grid display including a video area is sometimes referred to as a picture-in-picture (PIG) display. The PIG display and its functionality are described in more detail in U.S. Patent No. 6,564,378 issued to Satterfield et al. on May 13, 2003 and U.S. Patent No. 6,239,794 issued to Yuen et al. on May 29, 2001, both of which are incorporated herein by reference in their entirety. The PIG display may be included in other media guidance application display screens of the embodiments described herein.
[0071] Options area 926 may allow a user to access different types of content, media guidance application displays, and / or media guidance application features. Options area 926 may be part of display 900 (and other display screens described herein), or may be invoked by a user by selecting an option on the screen or pressing a dedicated or assignable button on a user input device. The selectable options within options area 926 may relate to features associated with the program listings in grid 902, or may include options available from a main menu display. Features associated with program listings may include searching for other airtimes or receiving programs, recording programs, enabling series recording of programs, setting programs and / or channels as favorites, ways to purchase programs, or other features. Options available from a main menu display may include search options, VOD options, parental control options, Internet options, cloud-based options, device synchronization options, second screen device options, options to access various types of media guidance data displays, options to subscribe to premium services, options to edit a user's profile, options to access a browsing overlay, or other options.
[0072] The media guidance application can be personalized based on the user's preferences. The personalized media guidance application allows the user to customize the display and features to create a personalized "experience" using the media guidance application. This personalized experience can be created by allowing the user to input these customizations and / or monitoring user activities through the media guidance application to determine various user preferences. Users can access their personalized guidance applications by logging in or otherwise identifying themselves to the guidance application. The customization of the media guidance application can be performed according to the user profile. Customization can include changing the presentation scheme (e.g., the color scheme of the display, the font size of the text, etc.), various aspects of the displayed content list (e.g., only HDTV or only 3D programs, user-specified broadcast channels based on favorite channel selections, reordering the display of channels, recommended content, etc.), desired recording features (e.g., recordings or series recordings for specific users, recording quality, etc.), parental control settings, customized presentation of Internet content (e.g., presentation of social media content, emails, electronically delivered articles, etc.), and other desired customizations.
[0073] The media guidance application may allow the user to provide user profile information, or may automatically compile user profile information. The media guidance application may, for example, monitor content accessed by the user and / or other interactions the user may have with the guidance application. In addition, the media guidance application may obtain all or part of other user profiles associated with the particular user (e.g., from other websites visited by the user on the Internet (such as www.Tivo.com), from other media guidance applications visited by the user, from other interactive applications visited by the user, from another user equipment device of the user, etc.), and / or obtain information about the user from other sources accessible by the media guidance application. Thus, a unified guidance application experience may be provided to the user across the user's different user equipment devices. The following is combined with Fig.12 This type of user experience is described in more detail. Additional personalized media guidance application features are described in more detail in U.S. Patent Application Publication No. 2005 / 0251827, filed July 11, 2005, to Ellis et al., U.S. Patent No. 7,165,098, issued January 16, 2007 to Boyer et al., and U.S. Patent Application Publication No. 2002 / 0174430, filed February 21, 2002, to Ellis et al., which are incorporated herein by reference in their entirety.
[0074] Another display arrangement for providing media guidance is Fig.10 1000. Video mosaic display 1000 includes selectable options 1002 for organizing content information based on content type, genre, and / or other organizational criteria. In display 1000, TV listings option 1004 is selected, thereby providing listings 1006, 1008, 1010, and 1012 as broadcast program listings. In display 1000, the listings may provide graphic images including cover art, still images from the content, video clip previews, live video from the content, or other types of content that indicate to the user the content described by the media guide data in the listing. Each graphical listing may also be accompanied by text to provide further information about the content associated with the listing. For example, listing 1008 may include more than one portion, including a media portion 1014 and a text portion 1016. Media portion 1014 and / or text portion 1016 may be selectable to view the content in full screen or to view information related to the content displayed in media portion 1014 (e.g., to view a list of channels that display the video).
[0075] The lists in display 1000 are of different sizes (i.e., list 1006 is larger than lists 1008, 1010, and 1012), but all lists can be the same size if desired. Lists can be of different sizes or graphically enhanced to indicate a level of user interest or to emphasize certain content, as desired by a content provider or based on user preferences. Various systems and methods for graphically enhancing content lists are discussed, for example, in U.S. Patent Application Publication No. 2010 / 0153885 to Yates, filed on November 12, 2009, which is incorporated herein by reference in its entirety.
[0076] Users may access the content and media guidance application (and its display screens described above and below) from one or more of their user equipment devices. Fig.11 A generalized embodiment of an illustrative user equipment device 1100 is shown. Fig.12 A more specific implementation of a user equipment device is discussed. User equipment device 1100 can receive content and data via input / output (hereinafter referred to as "I / O") path 1102. I / O path 1102 can provide content (e.g., broadcast programming, on-demand programming, Internet content, content available on a local area network (LAN) or wide area network (WAN), and / or other content) and data to control circuit system 1104, which includes processing circuit system 1106 and memory 1108. Control circuit system 1104 can be used to send and receive commands, requests, and other suitable data using I / O path 1102. I / O path 1102 can connect control circuit system 1104 (specifically processing circuit system 1106) to one or more communication paths (described below). I / O functionality can be provided by one or more of these communication paths, but in some embodiments, the I / O path 1102 can be connected to the control circuit system 1104 (specifically, processing circuit system 1106). Fig.11 is shown as a single path in order to avoid overcomplicating the diagram.
[0077] Control circuit system 1104 can be based on any suitable processing circuit system, such as processing circuit system 1106. As mentioned herein, processing circuit system should be understood to mean circuit system based on one or more microprocessors, microcontrollers, digital signal processors, programmable logic devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), etc., and can include multi-core processors (e.g., dual-core, quad-core, hexa-core, or any suitable number of cores) or supercomputers. In some embodiments, the processing circuit system can be distributed on multiple separate processors or processing units, such as multiple processing units of the same type (e.g., two Intel Core i7 processors) or multiple different processors (e.g., Intel Core i5 processors and Intel Core i7 processors). In some embodiments, control circuit system 1104 executes instructions for a media guidance application stored in a memory (i.e., storage device 1108). Specifically, control circuit system 1104 can be instructed by a media guidance application to perform the functions discussed above and below. For example, the media guidance application can provide instructions to control circuit system 1104 to generate a media guidance display. In some implementations, any actions performed by control circuitry 1104 may be based on instructions received from a media guidance application.
[0078] In a client-server based embodiment, control circuitry 1104 may include communication circuitry suitable for communicating with a guide application server or other network or server. Instructions for performing the above functions may be stored on the guide application server. The communication circuitry may include a cable modem, an integrated services digital network (ISDN) modem, a digital subscriber line (DSL) modem, a telephone modem, an Ethernet card or a wireless modem for communicating with other equipment, or any other suitable communication circuitry. Such communications may involve the Internet or any other suitable communication network or path (in combination with Fig.12 In addition, the communication circuitry may include circuitry that enables peer-to-peer communication of user equipment devices or communication of user equipment devices that are located remote from each other (described in more detail below).
[0079] The memory may be an electronic storage device provided as storage device 1108, which is part of the control circuit system 1104. As referred to herein, the phrase "electronic storage device" or "storage device" should be understood to mean any device for storing electronic data, computer software, or firmware, such as random access memory, read-only memory, a hard drive, an optical drive, a digital video disc (DVD) recorder, a compact disc (CD) recorder, a BLU-RAY disc (BD) recorder, a BLU-RAY 3D disc recorder, a digital video recorder (DVR, sometimes referred to as a personal video recorder or PVR), a solid-state device, a quantum storage device, a game console, game media, or any other suitable fixed or removable storage device, and / or any combination thereof. Storage device 1108 may be used to store the various types of content described herein as well as the media guide data described above. Non-volatile memory may also be used (e.g., to initiate startup routines and other instructions). With respect to Fig.12 The described cloud-based storage may be used in addition to storage 1108 or in place of storage 1108 .
[0080] The control circuit system 1104 may include a video generation circuit system and a tuning circuit system, such as one or more analog tuners, one or more MPEG-2 decoders or other digital decoding circuit systems, a high-definition tuner or any other suitable tuning or video circuit, or a combination of such circuits. A coding circuit system (e.g., for converting over-the-air, analog or digital signals into MPEG signals for storage) may also be provided. The control circuit system 1104 may also include a scaler circuit system for up-converting and down-converting content into a preferred output format of the user equipment 1100. The circuit system 1104 may also include a digital-to-analog converter circuit system and an analog-to-digital converter circuit system for converting between digital and analog signals. The tuning and coding circuit system may be used by the user equipment device to receive and display, play or record content. The tuning and coding circuit system may also be used to receive guide data. The circuit system described herein, including, for example, tuning, video generation, coding, decoding, encryption, decryption, scaler and analog / digital circuit system, may be implemented using software running on one or more general or special processors. Multiple tuners may be provided to handle simultaneous tuning functions (e.g., watch and record functions, picture-in-picture (PIP) functions, multi-tuner recording, etc.) If storage 1108 is provided as a device separate from user equipment 1100, the tuning and encoding circuitry (including the multiple tuners) may be associated with storage 1108.
[0081] The user can use the user input interface 1110 to send instructions to the control circuit system 1104. The user input interface 1110 can be any suitable user interface, such as a remote control, a mouse, a trackball, a keypad, a keyboard, a touch screen, a touch pad, a stylus input, a joystick, a voice recognition interface or other user input interface. The display 1112 can be provided as an independent device or integrated with other elements of the user equipment device 1100. For example, the display 1112 can be a touch screen or a touch-sensitive display. In this case, the user input interface 1110 can be integrated with the display 1112 or combined with the display 1112. Display 1112 may be one or more of a monitor, a television, a liquid crystal display (LCD) for a mobile device, an amorphous silicon display, a low temperature polysilicon display, an electronic ink display, an electrophoretic display, an active matrix display, an electrowetting display, an electrofluidic display, a cathode ray tube display, a light emitting diode display, an electroluminescent display, a plasma display panel, a high performance addressing display, a thin film transistor display, an organic light emitting diode display, a surface conduction electron emission display (SED), a laser television, a carbon nanotube, a quantum dot display, an interferometric modulator display, or any other suitable equipment for displaying visual images. In some embodiments, display 1112 may be HDTV capable. In some embodiments, display 1112 may be a 3D display, and the interactive media guidance application and any suitable content may be displayed in 3D. A video card or graphics card may generate output to display 1112. A video card may provide various functions, such as accelerated rendering of 3D scenes and 2D graphics, MPEG-2 / MPEG-4 decoding, TV output, or the ability to connect multiple displays. The video card may be any processing circuit system described above with respect to control circuit system 1104. The video card may be integrated with the control circuitry 1104. The speaker 1114 may be provided integrated with other elements of the user equipment device 1100, or may be a separate unit. The audio component of the video and other content displayed on the display 1112 may be played through the speaker 1114. In some embodiments, the audio may be distributed to a receiver (not shown), which processes and outputs the audio via the speaker 1114.
[0082] The guide application can be implemented using any suitable architecture. For example, it can be a stand-alone application implemented entirely on the user equipment device 1100. In this scheme, the instructions for the application are stored locally (e.g., stored in the storage device 1108), and the data used by the application is downloaded periodically (e.g., from an out-of-band feed, from an Internet resource, or using other suitable schemes). The control circuit system 1104 can retrieve the instructions for the application from the storage device 1108 and process the instructions to generate any display discussed herein. Based on the processed instructions, the control circuit system 1104 can determine what action to perform when an input is received from the input interface 1110. For example, when the input interface 1110 indicates that the up / down button is selected, the up / down movement of the cursor on the display can be indicated by the processed instructions.
[0083] In some embodiments, the media guidance application is a client-server based application. Data for use by a fat or thin client implemented on the user equipment device 1100 is retrieved on demand by making a request to a server remote from the user equipment device 1100. In one example of a client-server based guidance application, the control circuit system 1104 runs a web browser that interprets a web page provided by a remote server. For example, the remote server can store instructions for the application in a storage device. The remote server can use a circuit system (e.g., the control circuit system 1104) to process the stored instructions and generate the display discussed above and below. The client device can receive the display generated by the remote server and can display the displayed content locally on the equipment device 1100. In this way, the processing of the instructions is performed remotely by the server, while the resulting display is provided locally on the equipment device 1100. The equipment device 1100 can receive inputs from the user via the input interface 1110, and send those inputs to the remote server for processing and generating corresponding displays. For example, the equipment device 1100 can send a message to the remote server indicating that the up / down button has been selected via the input interface 1110. The remote server can process the instruction according to that input and generate a display of the application corresponding to the input (e.g., a display of moving a cursor up / down). The generated display is then sent to the equipment device 1100 for presentation to the user.
[0084] In some embodiments, the media guidance application is downloaded and interpreted or otherwise run by an interpreter or virtual machine (run by control circuit system 1104). In some embodiments, the guidance application may be encoded in ETV Binary Interchange Format (EBIF), received by control circuit system 1104 as part of a suitable feed, and interpreted by a user agent running on control circuit system 1104. For example, the guidance application may be an EBIF application. In some embodiments, the guidance application may be defined by a series of JAVA-based files that are received and run by a local virtual machine or other suitable middleware executed by control circuit system 1104. In some such embodiments (e.g., embodiments employing MPEG-2 or other digital media encoding schemes), the guidance application may be encoded and sent, for example, in an MPEG-2 object carousel with MPEG audio and video packets of a program.
[0085] Fig.11 The user equipment device 1100 can be Fig.12 The system 1200 of the present invention can be implemented as a user television equipment 1202, a user computer equipment 1204, a wireless user communication device 1206, or any other type of user equipment suitable for accessing content (such as a non-portable game console). For simplicity, these devices may be collectively referred to as user equipment or user equipment devices herein, and may be substantially similar to the user equipment devices described above. The user equipment device on which the media guidance application can be implemented can be used as a stand-alone device or can be part of a network of devices. Various network configurations of devices can be implemented and are discussed in more detail below.
[0086] Using the above combination Fig.11 The user equipment devices of at least some of the described system features may not be categorized as just user television equipment 1202, user computer equipment 1204, or wireless user communication device 1206. For example, user television equipment 1202 may be Internet enabled like some user computer equipment 1204 to allow access to Internet content, and user computer equipment 1204 may include a tuner like some television equipment 1202 to allow access to television programs. The media guidance application may have the same layout on various different types of user equipment, or may be tailored for the display capabilities of the user equipment. For example, on user computer equipment 1204, the guidance application may be provided as a website accessed by a web browser. In another example, the guidance application may be reduced for wireless user communication device 1206.
[0087] In system 1200, there is typically more than one of each type of user equipment device, but in Fig.12Only one of each type is shown in order to avoid overcomplicating the diagram. In addition, each user may utilize more than one type of user equipment device and more than one of each type of user equipment device.
[0088] In some embodiments, a user equipment device (e.g., user television equipment 1202, user computer equipment 1204, wireless user communication device 1206) may be referred to as a "second screen device". For example, a second screen device may supplement the content presented on a first user equipment device. The content presented on the second screen device may be any suitable content that supplements the content presented on the first device. In some embodiments, the second screen device provides an interface for adjusting the settings and display preferences of the first device. In some embodiments, the second screen device is configured to interact with other second screen devices or to interact with a social network. The second screen device may be located in the same room as the first device, in a different room from the first device but in the same house or building, or in a different building from the first device.
[0089] The user can also set various settings to maintain consistent media guidance application settings between home devices and remote devices. The settings include those described herein, as well as channel and program favorites, program preferences used by the guide application to make program recommendations, display preferences, and other desired guide settings. For example, if a user sets a channel on the website www.Tivo.com, for example, as a favorite on his or her personal computer at the office, the same channel will appear as a favorite on the user's home devices (e.g., user television equipment and user computer equipment) as well as the user's mobile device, if desired. Therefore, changes made on one user equipment device can change the guide experience on another user equipment device, regardless of whether they are the same type or different types of user equipment devices. In addition, the changes made can be based on settings entered by the user and user activities monitored by the guide application.
[0090] The user equipment devices may be coupled to a communication network 1214. That is, the user television equipment 1202, the user computer equipment 1204, and the wireless user communication device 1206 are coupled to the communication network 1214 via communication paths 1208, 1210, and 1212, respectively. The communication network 1214 may be one or more networks, including the Internet, a mobile phone network, a mobile voice or data network (e.g., a 4G or LTE network), a wired network, a public switched telephone network, or other type of communication network, or a combination of communication networks. Paths 1208, 1210, and 1212 may individually or together include one or more communication paths, such as satellite paths, fiber optic paths, cable paths, paths that support Internet communications (e.g., IPTV), free space connections (e.g., for broadcast or other wireless signals), or any other suitable wired or wireless communication paths or combinations of such paths. Path 1212 is drawn with a dotted line to indicate the location of the communication path. Fig.12 In the exemplary embodiment shown it is a wireless path, and paths 1208 and 1210 are drawn as solid lines to indicate that they are wired paths (however, if desired, these paths can be wireless paths). Communication with the user equipment device can be provided by one or more of these communication paths, but in Fig.12 is shown as a single path in order to avoid overcomplicating the diagram.
[0091] Although no communication paths are drawn between user equipment devices, these devices can communicate directly with each other via communication paths such as those described above in conjunction with paths 1208, 1210, and 1212, as well as other short-range point-to-point communication paths such as USB cables, IEEE 1394 cables, wireless paths (e.g., Bluetooth, infrared, IEEE 802-11x, etc.), or other short-range communications via wired or wireless paths. Bluetooth is a certification mark owned by Bluetooth SIG, Inc. User equipment devices can also communicate directly with each other through indirect paths via communication network 1214.
[0092] System 1200 includes content source 1216 and media guidance data source 1218 coupled to communication network 1214 via communication paths 1220 and 1222, respectively. Paths 1220 and 1222 may include any of the communication paths described above in connection with paths 1208, 1210, and 1212. Communications with content source 1216 and media guidance data source 1218 may be exchanged via one or more communication paths, but may be communicated to one or more communication paths. Fig.12 1216 and media guide data source 1218 may each exist at more than one, but Fig.12Only one of each is shown to avoid overcomplicating the drawing. (The different types of each of these sources are discussed below.) If desired, content source 1216 and media guidance data source 1218 may be integrated into one source device. Although communication between sources 1216 and 1218 and user devices 1202, 1204, and 1206 is shown as being through communication network 1214, in some embodiments, sources 1216 and 1218 may communicate directly with user devices 1202, 1204, and 1206 via communication paths (not shown), such as those described above in conjunction with paths 1208, 1210, and 1212.
[0093] Content sources 1216 may include one or more types of content distribution equipment, including television distribution facilities, cable system headends, satellite distribution facilities, program sources (e.g., television broadcasters, such as NBC, ABC, HBO, etc.), intermediate distribution facilities and / or servers, Internet providers, on-demand media servers, and other content providers. NBC is a trademark owned by National Broadcasting Corporation, ABC is a trademark owned by American Broadcasting Corporation, and HBO is a trademark owned by Home Box Office. Content sources 1216 may be the originator of the content (e.g., television broadcasters, network broadcast providers, etc.), or may not be the originator of the content (e.g., on-demand content providers, Internet providers of content for downloaded broadcast programs, etc.). Content sources 1216 may include cable sources, satellite providers, on-demand providers, Internet providers, over-the-top content providers, or other content providers. Content sources 1216 may also include remote media servers used to store different types of content (including user-selected video content) at locations away from any user equipment device. Systems and methods for remote storage of content and providing remotely stored content to user equipment are discussed in more detail in conjunction with US Patent No. 7,761,892 issued to Ellis et al. on July 20, 2010, which is incorporated herein by reference in its entirety.
[0094] Media guide data source 1218 may provide media guide data, such as the media guide data described above. The media guide data may be provided to user equipment devices using any suitable scheme. In some embodiments, the guide application may be a stand-alone interactive television program guide that receives program guide data via a data feed (e.g., a continuous feed or a trickle feed). Programming data and other guide data may be provided to user equipment on a television channel sideband using an in-band digital signal, using an out-of-band digital signal, or by any other suitable data transmission technology. Programming data and other media guide data may be provided to user equipment on multiple analog or digital television channels.
[0095] In some embodiments, guidance data from media guidance data source 1218 may be provided to a user's equipment using a client-server approach. For example, a user equipment device may pull media guidance data from a server, or a server may push media guidance data to a user equipment device. In some embodiments, a guidance application client resident on the user equipment may initiate a session with source 1218 to obtain guidance data when needed, e.g., when guidance data is out of date or when a user equipment device receives a request from a user to receive data. Media guidance may be provided to the user equipment at any appropriate frequency (e.g., continuously, daily, during a user-specified time period, during a system-specified time period, in response to a request from the user equipment, etc.). Media guidance data source 1218 may provide the media guidance application itself or software updates for the media guidance application to user equipment devices 1202, 1204, and 1206.
[0096] In some embodiments, the media guidance data may include viewer data. For example, viewer data may include current and / or historical user activity information (e.g., what content the user typically watches, at what time the user watches content, whether the user interacts with a social network, at what time the user interacts with a social network to post information, what type of content the user typically watches (e.g., pay TV or free TV), mood, brain activity information, etc.). The media guidance data may also include subscription data. For example, subscription data may identify which sources or services a given user subscribes to and / or which sources or services a given user previously subscribed to but later terminated access to (e.g., whether the user subscribes to premium channels, whether the user has added high-level services, whether the user has increased the speed of the Internet). In some embodiments, viewer data and / or subscription data may identify patterns for a given user over a period of more than one year. The media guidance data may include a model (e.g., a survivor model) for generating a score indicating the likelihood that a given user will terminate access to a service / source. For example, a media guidance application may use the model to process viewer data with subscription data to generate a value or score indicating the likelihood that a given user will terminate access to a particular service or source. In particular, a higher score may indicate a higher level of confidence that the user will terminate access to a particular service or source. Based on the score, the media guidance application may generate a promotion that entices the user to maintain a particular service or source that the score indicates the user is likely to terminate access to.
[0097] The media guidance application may be a stand-alone application implemented, for example, on a user equipment device. For example, the media guidance application may be implemented as software or an executable instruction set that may be stored in storage 1108 and executed by control circuit system 1104 of user equipment device 1100. In some embodiments, the media guidance application may be a client-server application, where only the client application resides on the user equipment device and the server application resides on a remote server. For example, the media guidance application may be implemented in part as a client application on control circuit system 1104 of user equipment device 1100, and in part as a server application (e.g., media guidance data source 1218) running on a control circuit system of a remote server. When executed by a control circuit system of a remote server (such as media guidance data source 1218), the media guidance application may instruct the control circuit system to generate a guidance application display and send the generated display to the user equipment device. The server application may instruct the control circuit system of media guidance data source 1218 to send data to be stored on the user equipment. The client application may instruct the control circuit system of the recipient user equipment to generate a guidance application display.
[0098] The content and / or media guidance data delivered to user equipment devices 1202, 1204, and 1206 may be over-the-top (OTT) content. OTT content delivery allows Internet-enabled user equipment (including any of the above-mentioned user equipment devices) to receive content transmitted over the Internet (including any of the above-mentioned content, except for content received via a cable or satellite connection). OTT content is delivered via an Internet connection provided by an Internet service provider (ISP), but a third party distributes the content. The ISP may not be responsible for viewing capabilities, copyrights, or redistribution of content, and may only transmit IP packets provided by OTT content providers. Examples of OTT content providers include YOUTUBE, NETFLIX, and HULU, which provide audio and video via IP packets. Youtube is a trademark owned by Google, Inc., Netflix is a trademark owned by Netflix, Inc., and Hulu is a trademark owned by Hulu, Inc. OTT content providers may additionally or alternatively provide the above-mentioned media guidance data. In addition to content and / or media guidance data, providers of OTT content may distribute media guidance applications (e.g., web-based applications or cloud-based applications), or may display content through media guidance applications stored on user equipment devices.
[0099] Media guidance system 1200 is intended to illustrate multiple scenarios or network configurations by which user equipment devices and content and guidance data sources can communicate with each other for the purpose of accessing content and providing media guidance. The embodiments described herein may be applied in any one or a subset of these scenarios, or in systems that employ other scenarios for delivering content and providing media guidance. The following four scenarios provide Fig.12 A specific description of the generalized example.
[0100] In one approach, user equipment devices may communicate with each other within a home network. User equipment devices may communicate with each other directly via the short-range point-to-point communication scheme described above, via an indirect path through a hub or other similar device provided on the home network, or via communication network 1214. Each of multiple individuals in a single household may operate a different user equipment device on the home network. Therefore, it may be desirable to transmit various media guidance information or settings between different user equipment devices. For example, as described in more detail in U.S. Patent Publication No. 2005 / 0251827 to Ellis et al. on July 11, 2005, a user may desire to maintain consistent media guidance application settings on different user equipment devices within a home network. Different types of user equipment devices in a home network may also communicate with each other to send content. For example, a user may send content from a user computer device to a portable video player or a portable music player.
[0101] In the second scheme, users may have multiple types of user equipment through which they access content and obtain media guidance. For example, some users may have a home network accessed by home and mobile devices. Users may control home devices through a media guidance application implemented on a remote device. For example, users may access an online media guidance application on a website via a personal computer in their office or a mobile device (such as a PDA or a web-enabled mobile phone). Users may set various settings (e.g., records, reminders, or other settings) on the online guidance application to control the user's home equipment. The online guide may directly control the user's equipment, or communicate with the media guidance application on the user's home equipment. For example, various systems and methods for user equipment device communication are discussed in U.S. Patent No. 8,046,801, granted on October 25, 2011, by Ellis et al., wherein the user equipment devices are located away from each other, and the patent is incorporated herein by reference in its entirety.
[0102] In a third scenario, users of user equipment devices inside and outside the home can use their media guidance applications to communicate directly with content sources 1216 to access content. Specifically, at home, users of user television equipment 1202 and user computer equipment 1204 can access the media guidance application to navigate therein and locate desired content. Users can also access the media guidance application outside the home using wireless user communication devices 1206 to navigate therein and locate desired content.
[0103] In a fourth solution, a user equipment device may operate in a cloud computing environment to access cloud services. In a cloud computing environment, various types of computing services (e.g., video sharing sites or social networking sites) for content sharing, storage, or distribution are provided by a collection of network-accessible computing and storage resources referred to as a "cloud." For example, a cloud may include a collection of server computing devices, which may be located in a centralized or distributed location, which provides cloud-based services to various types of users and devices connected via a network (such as the Internet) through a communication network 1214. These cloud resources may include one or more content sources 1216 and one or more media guide data sources 1218. In addition or in an alternative, a remote computing site may include other user equipment devices, such as a user television equipment 1202, a user computer equipment 1204, and a wireless user communication device 1206. For example, other user equipment devices may provide access to stored video copies or streaming video. In such an embodiment, the user equipment devices may operate in a peer-to-peer manner without communicating with a central server.
[0104] For user equipment devices, the cloud provides access to services such as content storage, content sharing, or social networking services, as well as access to any of the above content. Services may be provided in the cloud by cloud computing service providers or by providers of other online services. For example, cloud-based services may include content storage services, content sharing sites, social networking sites, or other services through which user-sourced content is distributed for viewing by others on connected devices. These cloud-based services may allow user equipment devices to store content to the cloud and receive content from the cloud, rather than storing content locally and accessing locally stored content.
[0105] Users can use various content capture devices (such as video cameras, digital cameras with video modes, audio recorders, mobile phones, and handheld computing devices) to record content. Users can directly upload content to the content storage service on the cloud (e.g., from user computer equipment 1204 or wireless user communication device 1206 with content capture features). Alternatively, the user can first transfer the content to a user equipment device (such as user computer equipment 1204). The user equipment device storing the content uploads the content to the cloud using a data transfer service on the communication network 1214. In some embodiments, the user equipment device itself is a cloud resource, and other user equipment devices can access the content directly from the user equipment device on which the user stores the content.
[0106] Cloud resources may be accessed by a user equipment device using, for example, a web browser, a media guidance application, a desktop application, a mobile application, and / or any combination thereof to access applications. The user equipment device may be a cloud client that relies on cloud computing for application delivery, or the user equipment device may have certain functionality without accessing cloud resources. For example, some applications running on the user equipment device may be cloud applications, i.e., applications delivered as a service over the Internet, while other applications may be stored and run on the user equipment device. In some embodiments, the user device may receive content from multiple cloud resources simultaneously. For example, a user device may stream audio from one cloud resource while downloading content from a second cloud resource. Or a user device may download content from multiple cloud resources for more efficient downloading. In some embodiments, the user equipment device may use cloud resources to process operations, such as those performed by a user regarding Fig.11 The processing operations performed by the processing circuitry are described.
[0107] As referred to herein, the term "in response to..." means initiated as a result of. For example, a first action being performed in response to a second action may include an intervening step between the first action and the second action. As referred to herein, the term "directly in response to..." means caused by. For example, a first action being performed directly in response to a second action may not include an intervening step between the first action and the second action.
[0108] Fig.13 is a flow chart of illustrative steps for a process 1300 for creating a query to search for supplemental content for an electronic book according to some embodiments of the present disclosure. It should be noted that the process 1300 or any of its steps may be performed in any manner. Figure 11-12 For example, process 1300 may be performed on a user device (e.g., user equipment devices 1202, 1204, and / or 1206 ( Fig.12 )) as directed by the control circuit system 1104 ( Fig.11 ) is executed to search for supplemental content. In addition, one or more steps of process 1300 can be incorporated into or combined with one or more steps of any other process or embodiment described herein.
[0109] Process 1300 depicts a process for creating a query for supplemental content for an electronic book and then generating the supplemental content. Process 1300 begins with control circuit system 1104 for a media guidance application receiving a selection by a reader of an electronic book of a portion of text in an electronic book display on a user device, which selection will be used to form a search query for supplemental content related to the electronic book (particularly, the selected portion of the electronic book). The reader may select a portion of text in the electronic book display. At step 1302, control circuit system 1104 for a media guidance application receives input of the selection of the portion. An example of a selected portion of text may be, for example, text 250 or 450 (respectively at Figure 2 and Figure 4 In some scenarios, user input of the selected portion may be performed automatically by the media guidance application and may be obtained from an electronic book metadata file regarding chapter summaries, keyword information or an electronic book database of book reviews, book descriptions or other book data aggregator sources.
[0110] At step 1304, user input may be received by control circuitry 1104 for the media guidance application and then analyzed or parsed to determine keywords. Linguistic analysis may be used to obtain one or more keywords parsed from the selected text to identify terms in the selected text, which may be nouns or may have a meaning such as using metadata in the electronic book file (e.g., 820( Figure 8 A manifest file for the electronic book (e.g., Figure 8 830) to identify terms about the electronic book that may be relevant to creating a search query. The manifest file can generate information about the chapter from which the selected portion of the text originates.
[0111] At step 1306, control circuitry 1104 may retrieve chapter information from manifest file 830. In addition, title information of the electronic book may be retrieved from manifest file 830 by control circuitry 1104 for the media guidance application. Chapter and title information may be included in an index in manifest file 830, and chapters may be identified using chapter or book content hierarchy information in manifest file 830.
[0112] At step 1308, a search query may be generated based on the keywords, and the criteria (chapter and title) in the manifest file may be sent from the user device (e.g., 1206) to a remote database by control circuitry 1104 for the media guidance application to search for supplemental content. The remote database may be a database of media content, and may be one or more databases. The remote database may be accessed via a network. Using the above example, matching content may be searched in a remote media database, and the story's progress information may be used and matched to the metadata of the media asset to refine the search. For example, when searching from a remote database, the search results may be used to identify the content of the story. Figure 2 When searching for "be our guest" 250 in the e-book shown in , a video clip of the song can be found as a matching supplemental content item. In addition, the movie "Beauty and the Beast" can be identified, and in particular, the closed captioning information of the movie can be used to identify the part of the movie in which the song appears to identify where the song appears. The matching movie can be presented as supplemental content and displayed starting from the location where the song appears in the movie. Similarly, for slogans delivered verbally or visually, the closed captioning data can be used to identify the slogan and present the slogan to the user at the time when the slogan appears. In addition to searching the closed captioning data, the media guidance application can also search user-generated comments about the media assets to further refine the time point details used to display related supplemental content.
[0113] The remote database will provide matching search results for the query to the control circuit system 1104 for the media control application, and in some scenarios, a list of matching search results may be displayed to the user for selection. Such a list will be generated by the control circuit system 1104 for the media guidance application for display on the user device. In other examples, at step 1310, the control circuit system 1104 for the media guidance application will automatically receive a matching supplemental content item. At step 1312, the received supplemental content may be generated to the user's display. The search results and the query may be displayed in accordance with Fig.15 Refine the steps shown in .
[0114] expected Fig.13 The steps or descriptions of can be used with any other embodiment of the present disclosure. Fig.13 The steps and descriptions described may be performed in alternative orders or in parallel to further achieve the objectives of the present disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method. Any of these steps may also be skipped or omitted from the process. In addition, it should be noted that with respect to Figure 11-12 Any of the equipment or devices discussed may be used to perform Fig.13One or more steps in .
[0115] Fig.14 is a flow chart of illustrative steps of a process 1400 for creating a query to search for supplemental content of an electronic book according to some embodiments of the present disclosure. It should be noted that the process 1400 or any of its steps may be performed in any manner. Figure 11-12 For example, process 1400 may be performed on a user device (e.g., user equipment devices 1202, 1204, and / or 1206 ( Fig.12 )) as directed by the control circuit system 1104 ( Fig.11 ) is executed to search for supplemental content. In addition, one or more steps of process 1400 can be incorporated into or combined with one or more steps of any other process or embodiment described herein.
[0116] Process 1400 depicts a process for creating a query for supplemental content for an electronic book and then generating the supplemental content. Process 1400 begins with control circuit system 1104 for a media guidance application receiving a selection by a reader of an electronic book of a portion of text in an electronic book display on a user device, which selection will be used to form a search query for supplemental content related to the electronic book (particularly, the selected portion of the electronic book). The reader may select a portion of text in the electronic book display. At step 1402, control circuit system 1104 for a media guidance application receives input of the selection of the portion. Examples of the selected portion of text may be, for example, text 250 or 450 (in Figure 2 and Figure 4 In some scenarios, the selected portion received by the media guidance application can be automatically received by the media guidance application using the electronic book file and corresponding manifest file information of the electronic book text, as well as information about the electronic book text in the metadata of the electronic book (including chapter summaries, slogans, keywords, or electronic book reviews in book reviews, bookstore listings, book blogs, or other electronic book information sources).
[0117] At step 1404, user input may be received by control circuitry 1104 for the media guidance application and then analyzed or parsed to determine keywords. Linguistic analysis may be used to obtain one or more keywords parsed from the selected text to identify terms in the selected text, which may be nouns or may have a meaning such as using metadata in the electronic book file (e.g., 820( Figure 8 A manifest file for the electronic book (e.g., Figure 8830) to identify terms about the electronic book that may be relevant to creating a search query. The manifest file can generate information about the chapter from which the selected portion of the text originates.
[0118] At step 1406, control circuitry 1104 may retrieve from a manifest file (e.g., manifest file 830) to obtain chapter and title information for the electronic book. The chapter and title information may be included in an index in manifest file 830, and the chapters may be identified by control circuitry 1104 for the media guidance application using chapter or book content hierarchy information in manifest file 830.
[0119] At step 1408, control circuitry 1104 for the media guidance application will automatically select the retrieved title as the first criterion to be included in the search query. At this step, the search query will include the selected criteria of the keyword and title from step 1404. Figure 2 In the example of , "be our guest" as the selected portion of text can generate the keyword "guest" or the keyword phrase "be our guest" because "be our guest" is the tagline of "Beauty and the Beast" and it can be annotated in the metadata 820 of the e-book, and a search query initiated with "be our guest" will add the condition of the book title "Beauty and the Beast". Adding this condition will focus the search in the context of the book. Similarly, using Figure 4 In the book example in , the selected text portion "there was my beastface again" will result in a search for the keyword phrase of the noun in that portion - "beast face", and the title of the book - "Beastly Kendra Chronicles" as search criteria.
[0120] At step 1410, the control circuitry 1104 for the media guidance application will automatically select the retrieved chapter from the manifest file to include in the search query as a second condition. In the above example, this will result in the locator (if the chapter is not available) being matched to the search query. Figure 2 , and for Figure 4In a search for "Beastly Kendra Chronicles" in the media, chapter 3 (435) can be included in the search query as another condition. Using the locator information can add additional context to the search because the percentage progress of the location of the selected text can be roughly related to certain items of media. In addition, the chapter summary information of, for example, chapter 3 of "Beastly Kendra Chronicles" can be parsed to find additional keywords that can be matched with the media item description information or closed caption metadata or other media item details.
[0121] At step 1412, the control circuit system 1104 for the media guidance application will generate a query for supplemental content related to the e-book (using the keywords determined from step 1404, the first condition from step 1408 - the chapter or location of the selected text, and the second condition from step 1410 - the title of the e-book).
[0122] At step 1414, control circuitry 1104 for the media guidance application may send the generated search query from the user device (e.g., 1206) to a remote database to search for supplemental content. The remote database may be a database of media content, and may be one or more databases. The remote database may be accessed via a network. Using the above example, the remote media database may be searched for matching content, and the story's progress information may be used and matched to the metadata of the media asset to refine the search. For example, when the search query is from a remote database, the search query may be sent to the remote database. Figure 2 When searching for "be our guest" 250 in the e-book shown in , a video clip of the song can be found as a matching supplemental content item. In addition, the movie "Beauty and the Beast" can be identified, and in particular, the closed captioning information of the movie can be used to identify the part of the movie in which the song appears to identify where the song appears. The matching movie can be presented as supplemental content and displayed starting from the location where the song appears in the movie. Similarly, for slogans delivered verbally or visually, the closed captioning data can be used to identify the slogan and present the slogan to the user at the time when the slogan appears. In addition to searching the closed captioning data, the media guidance application can also search user-generated comments about the media assets to further refine the time point details used to display related supplemental content.
[0123] The remote database will provide matching search results for the query to the control circuitry 1104 for the media guidance application, and in some scenarios, a list of matching search results may be displayed to the user for selection. Such a list will be generated by the control circuitry 1104 for the media guidance application for display on the user device. In other examples, at step 1416, the control circuitry 1104 for the media guidance application will automatically receive a matching supplemental content item. At step 1418, the received supplemental content may be generated to the user's display. The search results and the query may be displayed in accordance with Fig.14 Refine the steps shown in .
[0124] expected Fig.14 The steps or descriptions of can be used with any other embodiment of the present disclosure. Fig.14 The steps and descriptions described may be performed in alternative orders or in parallel to further achieve the objectives of the present disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method. Any of these steps may also be skipped or omitted from the process. In addition, it should be noted that with respect to Figure 11-12 Any of the equipment or devices discussed may be used to perform Fig.14 One or more steps in .
[0125] Fig.15 is a flow chart of illustrative steps of a process 1500 for searching for supplemental content for an electronic book according to some embodiments of the present disclosure. It should be noted that the process 1500 or any of its steps may be performed in any manner. Figure 11-12 For example, process 1500 may be performed on a user device (e.g., user equipment devices 1202, 1204, and / or 1206 ( Fig.12 )) as directed by the control circuit system 1104 ( Fig.11 ) is executed to search for supplemental content. In addition, one or more steps of process 1500 can be incorporated into or combined with one or more steps of any other process or embodiment described herein.
[0126] Process 1500 may be followed to identify supplemental content related to an electronic book. At step 1510, a query for supplemental content may be received by control circuitry 1104 for a media guidance application. The query may be initiated by a reader of the electronic book selecting a portion of the book (e.g., 250 and 450), by selecting an option for supplemental content (e.g., buttons 260 and 460), or by selecting a highlighted portion of the electronic book text indicated as having relevant content. In some scenarios, the selected portion received by the media guidance application may be automatically received by the media guidance application using the electronic book file and corresponding manifest file information of the electronic book text, as well as information about the electronic book text in metadata of the electronic book (including chapter summaries, slogans, keywords, or reviews of the electronic book in book reviews, bookstore listings, book blogs, or other electronic book information sources).
[0127] At step 1520, the user device control circuit system 1104 may analyze the electronic book manifest file to determine the conditions to be included in the search query. For example, the manifest file 830 may include detailed information about the book, chapters, and pages, and may include a timeline for the story progression that may affect the search results. Chapter summary information may also be obtained in the metadata 820, which may be used to refine the search query.
[0128] At step 1530, control circuitry 1104 for the media guidance application may send a search query based on the criteria from the manifest file and the text of the supplemental content query to a remote media database to search for matching supplemental content.
[0129] At step 1540, matching supplemental content may be identified from the remote database. Matching to the query may be performed using metadata for the media assets from the remote database to find content with a suitable age range, genre, or descriptive information relevant to the query, for example. Additionally, user preference information may be used to enhance the search. The media guidance application may then determine which matching supplemental content to present to the user.
[0130] At step 1550, control circuit system 1104 may check the user preference profile to determine if there are any user preferences associated with the matching supplemental content media item. For example, a user's preference for rated content may indicate the user's relative age. Thus, for a user from Figure 4 In the example of , a search for the young adult book "Kendra Beastly Chronicles" may yield television episodes of the series "Beauty and the Beast", which has a TV rating of TV-15 and a parental content guide. Figure 2In the example of the children's book "Beauty and the Beast", the search results may omit the TV series because it is not suitable for children. In addition, for users who prefer cartoons, the search results may include the cartoon adaptation of the book. On the other hand, for users who prefer musicals, the live-action version of "Beauty and the Beast" may be included in the search results.
[0131] At step 1560, if there is an item matching the user preference profile, then the control circuit system 1104 for the media guidance application can generate a list of matching supplementary content media items related to the user preferences. However, if there is no connection with the user preference profile, then the user device will continue to use the same list of matching supplementary content media items identified at step 1540.
[0132] At step 1570, both lists from steps 1560 and 1565 are checked for user controls. User controls can be a determination of whether there are any access restrictions to the media item that may affect displaying the media item or that may make sharing the media item problematic. For example, movies rated above PG-13, or television rated TV-15 and above, or explicit indications, may cause the media item to be presented in the list in a restricted or attention-seeking manner. For example, if the user wishes to limit access to such content, but also has a user history of viewing such content, then, for example, from Figure 2 A search for the children's book "Beauty and the Beast" in will produce search results for a television series with the same title - "Beauty and the Beast" - but presented in a way that makes it clear that it has a rating beyond the user's preferences.
[0133] At step 1575, if there is a user control for the media item, then the list of search results may be presented according to the user control. If there is no user control for the media item, then the list of search results may be displayed as the list from previous steps 1560 and 1565. In some scenarios, a single search result may be identified as the most relevant, and supplemental content items for that search result may be automatically displayed by the media guidance application on the reader's device or the second device.
[0134] expected Fig.15 The steps or descriptions of can be used with any other embodiment of the present disclosure. Fig.15The steps and descriptions described may be performed in alternative orders or in parallel to further achieve the objectives of the present disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method. Any of these steps may also be skipped or omitted from the process. In addition, it should be noted that with respect to Figure 11-12 Any of the equipment or devices discussed may be used to perform Fig.15 One or more steps in .
[0135] Fig.16 is a flow chart of illustrative steps of a process 1600 for filtering a search for supplemental content for an electronic book according to some embodiments of the present disclosure. It should be noted that the process 1600 or any of its steps may be performed in any manner. Figure 11-12 For example, process 1600 may be performed on a user device (e.g., user equipment devices 1202, 1204, and / or 1206 ( Fig.12 )) as directed by the control circuit system 1104 ( Fig.11 ) is executed to search for supplemental content. In addition, one or more steps of process 1600 can be incorporated into or combined with one or more steps of any other process or embodiment described herein.
[0136] Fig.16 An illustrative process 1600 is depicted for filtering a search query for supplemental content for an electronic book using detailed information in an electronic book manifest file. At step 1610, a reader of the electronic book may initiate a search for supplemental content by selecting a portion of text in the electronic book, and control circuitry 1104 for a media guidance application receives the selected portion of text. For example, the reader may select text from the electronic book, or select a highlighted phrase in the electronic book, such as 250 or 450 (in the order of 100, ... Figure 2 and Figure 4 For example, control circuit system 1104 may receive a user selection of text from an electronic book. In some scenarios, the selected portion received by the media guidance application may be automatically received by the media guidance application using the electronic book file and corresponding manifest file information of the electronic book text, as well as information about the electronic book text in the metadata of the electronic book (including chapter summaries, slogans, keywords, or electronic book reviews in book reviews, bookstore listings, book blogs, or other electronic book information sources).
[0137] At step 1615, control circuitry 1104 for the media guidance application may parse the selected portion of text to determine keywords in the portion of text. One or more keywords parsed from the selected text may be obtained using linguistic analysis to identify terms in the selected text, which may be nouns or may have semantic meanings such as using metadata in an electronic book file (e.g., 820( Figure 8 At step 1620, the parsed keywords may be used as a basis for the control circuit system 1104 to generate a search query.
[0138] At step 1625, the control circuitry 1104 of the user device may send the search query to a remote database to search for supplemental content that matches the search query.
[0139] The remote database or more than one media database may be searched for supplemental content matching the search query.The metadata of the media items may also be analyzed to find suitable matching content.
[0140] At step 1630, control circuitry 1104 for the media guidance application may receive a plurality of results for the keyword search from the remote database. Because there may be many search results, the results may be filtered to reduce the number of results or to increase the relevance of the results.
[0141] At step 1635, control circuit system 1104 for the media guidance application may retrieve a manifest file for the electronic book. The manifest file contains data about the electronic book, including the title of the electronic book and the chapter of the electronic book from which the portion of text was selected. A manifest file (e.g., 830) may be obtained from electronic book file 800 and may include information related to the location of the portion of text used to initiate the search query. The manifest file details of the keyword source location may be helpful in identifying clips from a movie related to a portion of the electronic book, or episodes from a television series adaptation of the electronic book, etc. For example, Figure 4 Search from Beastly Kendra Chronicles or Figure 2 Searches from Beauty and the Beast can be filtered by criteria in the corresponding manifest file.
[0142] Then, at step 1640, control circuitry 1104 for the media guidance application may filter the search results using the two conditions in the manifest file: title and chapter.
[0143] The filtered search results may be included in a final search results list generated by control circuitry 1104 for the media guidance application at step 1645 for display at the user device. The final search results list may include search results that match the keyword and have been filtered by the conditions identified from manifest file 830 of the electronic book. Figure 2 Multiple search results for "be our guest" for an e-book initiated from may be filtered to remove instances of, for example, the American Horror Story episode titled "Be our Guest," and to include only items related to the book "Beauty and the Beast."
[0144] At step 1650 , control circuitry 1104 for a media guidance application running, for example, on an electronic book reader, may receive a second user input selecting one of the search results in the search list generated at step 1645 .
[0145] In response to the second user input selection, the user device may receive a supplemental content item corresponding to the selected search result at step 1655. The supplemental content item may be received from a media content database (e.g., 1216) or other media source. The media content database may be selected for receiving the supplemental content based on the access availability of the user and the media guidance application, the quality or reliability of the data feed for the content, or based on the type of device on which the supplemental content will be delivered. For example, a television may benefit from supplemental content of a higher resolution source file, while a portable device may benefit from a lighter or shorter version of the supplemental content. Network availability and capabilities may also affect the selection of a media source.
[0146] At step 1660, the received supplemental content item may be viewed in a display. In some scenarios, the supplemental content display will be generated on the user device on which the search query was initiated at step 1610. In other scenarios, the supplemental content display will be generated on a second user device.
[0147] In some scenarios where a media guidance application is automatically performing a search for supplemental content using a selected text portion in an electronic book text, the search results for the supplemental content may be stored in association with the text portion, for example, in metadata for the electronic book file or in an electronic book database of related content.
[0148] expected Fig.16 The steps or descriptions of can be used with any other embodiment of the present disclosure. Fig.16The steps and descriptions described may be performed in alternative orders or in parallel to further achieve the objectives of the present disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method. Any of these steps may also be skipped or omitted from the process. In addition, it should be noted that with respect to Figure 11-12 Any of the equipment or devices discussed may be used to perform Fig.16 One or more steps in .
[0149] Fig.17 is a flow chart of illustrative steps of a process 1700 for filtering a search for supplemental content for an electronic book according to some embodiments of the present disclosure. It should be noted that the process 1700 or any of its steps may be performed in any manner. Figure 11-12 For example, process 1700 may be performed on a user device (e.g., user equipment devices 1202, 1204, and / or 1206 ( Fig.12 )) as directed by the control circuit system 1104 ( Fig.11 ) is executed to search for supplemental content. In addition, one or more steps of process 1700 can be incorporated into or combined with one or more steps of any other process or embodiment described herein.
[0150] Fig.17 An illustrative process 1700 is depicted for filtering a search query for supplemental content for an electronic book using detailed information in an electronic book manifest file. At step 1710, a reader of the electronic book may initiate a search for supplemental content by selecting a portion of text in the electronic book, and control circuitry 1104 for a media guidance application receives the selected portion of text. For example, the reader may select text from the electronic book, or select a highlighted phrase in the electronic book, such as 250 or 450 (in 100,000 words, respectively). Figure 2 and Figure 4 For example, control circuit system 1104 may receive a user selection of text from an electronic book. In some scenarios, the selected portion received by the media guidance application may be automatically received by the media guidance application using the electronic book file and corresponding manifest file information of the electronic book text, as well as information about the electronic book text in the metadata of the electronic book (including chapter summaries, slogans, keywords, or electronic book reviews in book reviews, bookstore listings, book blogs, or other electronic book information sources).
[0151] At step 1715, control circuitry 1104 for the media guidance application may parse the selected portion of text to determine keywords in the portion of text. One or more keywords parsed from the selected text may be obtained using linguistic analysis to identify terms in the selected text, which may be nouns or may have semantic meanings such as using metadata in an electronic book file (e.g., 820( Figure 8 At step 1720, the parsed keywords may be used as a basis for the control circuit system 1104 to generate a search query.
[0152] At step 1725, the control circuitry 1104 of the user device may send the search query to a remote database to search for supplemental content that matches the search query.
[0153] The remote database or more than one media database may be searched for supplemental content matching the search query.The metadata of the media items may also be analyzed to find suitable matching content.
[0154] At step 1730, control circuitry 1104 for the media guidance application may receive a plurality of results of the search for the keyword from the remote database. Because there may be many search results, the results may be filtered to reduce the number of results or to increase the relevance of the results.
[0155] At step 1735, control circuit system 1104 for the media guidance application may retrieve a manifest file for the electronic book. The manifest file contains data about the electronic book, including the title of the electronic book and the chapter of the electronic book from which the portion of text was selected. A manifest file (e.g., 830) may be obtained from electronic book file 800 and may include information related to the location of the portion of text used to initiate the search query. The manifest file details of the keyword source location may be helpful in identifying clips from a movie related to a portion of the electronic book, or episodes from a television series adaptation of the electronic book, etc. For example, Figure 4 Search from Beastly Kendra Chronicles or Figure 2 Searches from Beauty and the Beast can be filtered by criteria in the corresponding manifest file.
[0156] At step 1740, control circuitry 1104 for the media guidance application may select a title from the manifest file as a first condition. Figure 2 The search for "be our guest" 250 in the title can be filtered using the first condition of the title - Beauty and the Beast. And for Figure 4A search for "there was my beastface again" 450 in the search results can be filtered using the first term of the corresponding title - Beastly Kendra Chronicles.
[0157] At step 1745, control circuitry 1104 for the media guidance application may select a chapter as a second condition based on the manifest file. The chapter or position information may be used to find matching media related to the progress in the story.
[0158] Then, at step 1750, control circuitry 1104 for the media guidance application may use these two conditions to filter the search results.
[0159] The filtered search results may be included in a final search results list generated by control circuitry 1104 for the media guidance application at step 1755 for display at the user device. The final search results list may include search results that match the keyword and that have been filtered by the criteria identified from the electronic book's manifest file 830 at steps 1740 and 1745. Thus, the search results from, for example, Figure 2 Multiple search results for "be our guest" for an e-book initiated from a search in may be filtered to remove instances of, for example, the American Horror Story episode titled "Be our Guest" and to include only items related to the book "Beauty and the Beast."
[0160] At step 1760 , control circuitry 1104 for a media guidance application running, for example, on an electronic book reader, may receive a second user input selecting one of the search results in the search list generated at step 1755 .
[0161] In response to the second user input selection, the user device may receive a supplemental content item corresponding to the selected search result at step 1765. The supplemental content item may be received from a media content database (e.g., 1216) or other media source. The media content database may be selected for receiving the supplemental content based on the access availability of the user and the media guidance application, the quality or reliability of the data feed for the content, or based on the type of device on which the supplemental content will be delivered. For example, a television may benefit from supplemental content of a higher resolution source file, while a portable device may benefit from a lighter or shorter version of the supplemental content. Network availability and capabilities may also affect the selection of a media source.
[0162] At step 1770, the received supplemental content item may be viewed in a display. In some scenarios, the supplemental content display will be generated on the user device on which the search query was initiated at step 1710. In other scenarios, the supplemental content display will be generated on a second user device.
[0163] expected Fig.17 The steps or descriptions of can be used with any other embodiment of the present disclosure. Fig.17 The steps and descriptions described may be performed in alternative orders or in parallel to further achieve the objectives of the present disclosure. For example, each of these steps may be performed in any order or in parallel or substantially simultaneously to reduce lag or increase the speed of the system or method. Any of these steps may also be skipped or omitted from the process. In addition, it should be noted that with respect to Figure 11-12 Any of the equipment or devices discussed may be used to perform Fig.17 One or more steps in .
[0164] The processing discussed above is intended to be illustrative rather than restrictive. The examples described herein in connection with e-books may also be applied in other media environments. It will be appreciated by those skilled in the art that the steps of the processing discussed herein may be omitted, modified, combined and / or rearranged, and any additional steps may be performed without departing from the scope of the present invention. More generally, the above disclosure is exemplary rather than restrictive. Only the appended claims are intended to set the scope of the present invention. In addition, it should be noted that the features and limitations described in any one embodiment may be applied to any other embodiment herein, and the flowcharts or examples associated with one embodiment may be combined with any other embodiment in a suitable manner, may be completed in a different order, or may be completed in parallel. In addition, the systems and methods described herein may be executed in real time. It should also be noted that the above-described systems and / or methods may be applied to other systems and / or methods, or may be used according to other systems and / or methods.
Claims
1. A method for providing supplemental content accompanying an electronic book, the method comprising: receiving user input selecting a portion of text in an electronic book displayed on a user device; parsing the portion of text at the user device to determine keywords in the portion of text; retrieving a manifest file for the electronic book at the user device, wherein the manifest file indicates a title of the electronic book and a chapter of the electronic book from which the portion of text was selected, wherein the chapter includes percentage information of progress toward completion of the electronic book; automatically selecting the title at the user device based on the manifest file as a first condition; automatically selecting, at the user equipment, the chapter including the percentage information based on the manifest file as a second condition; automatically selecting, at the user device, a keyword from chapter summary information corresponding to a chapter of the electronic book from which the portion of text was selected as a third condition; generating, at a user device, a query for supplemental content based on the keyword, the first condition, the second condition, and the third condition; sending the query from the user device to a remote media database, wherein the remote media database is searched for supplemental content items that match the keyword, the first condition, the second condition, and the third condition, and the supplemental content items include associated media items, wherein content of the associated media items is contextually relevant to content of the electronic book; receiving, at a user device, the associated media items; matching the percentage information to a point in the associated media item corresponding to the portion of the selected text in the electronic book; as well as The associated media item is displayed at a user device from the point corresponding to the portion of the selected text in the electronic book.
2. The method of claim 1, further comprising filtering the search results based on a fourth condition, wherein the fourth condition is based on at least one of the following: the page number of the portion of text indicated by the manifest file; the line number of the portion of text indicated by the manifest file; the segment number of the portion of text indicated by the manifest file; the scene of the portion of text indicated by the manifest file; or An electronic bookmark for the portion of text indicated by the manifest file.
3. The method of claim 1, further comprising: A fifth condition for filtering the search results is automatically selected at the user device, wherein the fifth condition is based on a version of the movie associated with the electronic book.
4. The method of claim 1, further comprising identifying the portion of text by receiving user input to highlight the portion of text by generating an EPUB overlay class for the portion of text.
5. The method of claim 1, further comprising: providing a selectable option for sharing the supplemental content with a second user device; as well as In response to receiving user input selecting the selectable option, the associated media item is displayed on the second user device from a point corresponding to the selected portion of the text.
6. The method of claim 1, further comprising: Identify sentences in the e-book that correspond to the supplemental content; as well as Visual highlighting is applied to the sentence by generating an EPUB overlay class for the sentence and an indicator in the overlay class indicating supplemental content.
7. The method of claim 1, wherein automatically selecting the chapter comprises: The page number in the electronic book corresponding to the user's progress is determined based on the last displayed page of the text of the electronic book.
8. The method of claim 1 further includes generating, at a user device, a selectable indicator embedded in the electronic book display on the same page as the portion of the text, wherein the selectable indicator, when selected, causes an associated media item to be displayed at the user device from a point corresponding to the selected portion of the text.
9. The method of claim 1, further comprising: At the user device (a) associated media items are displayed from a point corresponding to the selected portion of text and (b) a selectable option for returning to the portion of text is displayed.
10. The method of claim 1 or 5, wherein displaying the associated media item at the user device or the second user device further comprises: A determination is made based on the content control whether the associated media item can be displayed.
11. The method of claim 1, wherein the associated media item comprises a movie version of an electronic book.
12. A system for providing supplemental content accompanying an electronic book, the system comprising: input / output (I / O) interface circuitry configured to receive user input; as well as A control circuit system is configured to: receiving user input selecting a portion of text in an electronic book displayed on a user device; parsing the portion of text at the user device to determine keywords in the portion of text; retrieving a manifest file for the electronic book at the user device, wherein the manifest file indicates a title of the electronic book and a chapter of the electronic book from which the portion of text was selected, wherein the chapter includes percentage information of progress toward completion of the electronic book; automatically selecting the title at the user device based on the manifest file as a first condition; automatically selecting, at the user equipment, the chapter including the percentage information based on the manifest file as a second condition; automatically selecting, at the user device, a keyword from chapter summary information corresponding to a chapter of the electronic book from which the portion of text was selected as a third condition; generating, at a user device, a query for supplemental content based on the keyword, the first condition, the second condition, and the third condition; sending the query from the user device to a remote media database, wherein the remote media database is searched for supplemental content items that match the keyword, the first condition, the second condition, and the third condition, and the supplemental content items include associated media items, wherein content of the associated media items is contextually relevant to content of the electronic book; receiving, at a user device, the associated media items; matching the percentage information to a point in the associated media item corresponding to the portion of the selected text in the electronic book; as well as The associated media item is displayed at a user device from the point corresponding to the portion of the selected text in the electronic book.
13. The system of claim 12, wherein the control circuit system is further configured to filter the search results based on a fourth condition, wherein the fourth condition is based on at least one of: the page number of the portion of text indicated by the manifest file; the line number of the portion of text indicated by the manifest file; the segment number of the portion of text indicated by the manifest file; the scene of the portion of text indicated by the manifest file; or An electronic bookmark for the portion of text indicated by the manifest file.
14. The system of claim 12, wherein the control circuit system is further configured to: A fifth condition for filtering the search results is automatically selected at the user device, wherein the fifth condition is based on a version of the movie associated with the electronic book.
15. The system of claim 12, wherein the control circuitry is further configured to identify the portion of text by receiving user input to highlight the portion of text by generating an EPUB overlay class for the portion of text.
16. The system of claim 12, wherein the control circuit system is further configured to: providing a selectable option for sharing the supplemental content with a second user device; and In response to receiving user input selecting the selectable option, the associated media item is displayed on the second user device from a point corresponding to the selected portion of the text.
17. The system of claim 12, wherein the control circuit system is further configured to: Identify sentences in the eBook that correspond to the Supplemental Content; and Visual highlighting is applied to the sentence by generating an EPUB overlay class for the sentence and an indicator in the overlay class indicating supplemental content.
18. The system of claim 12, wherein the control circuitry is configured to automatically select the chapter and further configured to determine a page number corresponding to a user's progress in the electronic book based on a last displayed page of text of the electronic book.
19. A system as described in claim 12, wherein the control circuit system is further configured to: generate a selectable indicator embedded in the electronic book display on the same page as the portion of the text at the user device, wherein the selectable indicator, when selected, causes an associated media item to be displayed at the user device from a point corresponding to the selected portion of the text.
20. A system as described in claim 12, wherein the control circuit system is further configured to: at a user device, (a) display associated media items from a point corresponding to the selected portion of text and (b) display a selectable option for returning to the portion of text.
21. The system of claim 12 or 16, wherein the control circuit system is configured to display the associated media item at the user device or a second user device, and is further configured to determine whether the associated media item can be displayed based on content control.
22. The system of claim 12, wherein the associated media item comprises a movie version of an electronic book.
23. A system for providing supplemental content accompanying an electronic book, the system comprising: means for receiving user input selecting a portion of text in an electronic book displayed on a user device; means for parsing the portion of text at a user device to determine keywords in the portion of text; means for retrieving a manifest file for the electronic book at the user device, wherein the manifest file indicates a title of the electronic book and a chapter of the electronic book from which the portion of text was selected, wherein the chapter includes percentage information of progress toward completion of the electronic book; means for automatically selecting the title as a first condition at a user device based on a manifest file; means for automatically selecting, at a user equipment, the chapter including the percentage information as a second condition based on a manifest file; means for automatically selecting, at the user device, a keyword as a third condition from chapter summary information corresponding to a chapter of the electronic book from which the portion of text was selected; means for generating, at a user device, a query for supplemental content based on the keyword, the first condition, the second condition, and the third condition; means for sending the query from the user device to a remote media database, wherein the remote media database is searched for supplemental content items that match the keyword, the first condition, the second condition, and the third condition, and wherein the supplemental content items include associated media items, wherein content of the associated media items is contextually relevant to content of the electronic book; means for receiving, at a user device, the associated media items; means for matching the percentage information to a point in the associated media item corresponding to the portion of the selected text in the electronic book; as well as Means for displaying, at a user device, the associated media item from a point corresponding to the portion of text selected in the electronic book.
24. The system of claim 23, further comprising means for filtering the search results based on a fourth condition, wherein the fourth condition is based on at least one of: the page number of the portion of text indicated by the manifest file; the line number of the portion of text indicated by the manifest file; the segment number of the portion of text indicated by the manifest file; the scene of the portion of text indicated by the manifest file; or An electronic bookmark for the portion of text indicated by the manifest file.
25. The system of claim 23, further comprising: Means for automatically selecting, at the user device, a fifth condition for filtering search results, wherein the fifth condition is based on a version of a movie associated with the electronic book.
26. The system of claim 23, further comprising means for identifying the portion of text by receiving user input to highlight the portion of text by generating an EPUB overlay class for the portion of text.
27. The system of claim 23, further comprising: means for providing a selectable option for sharing the supplemental content with a second user device; as well as In response to receiving user input selecting the selectable option, means for displaying, on the second user device, the associated media item from a point corresponding to the selected portion of the text.
28. The system of claim 23, further comprising: means for determining a sentence in the electronic book corresponding to the supplemental content; as well as Means for applying visual highlighting to the sentence by generating an EPUB overlay class for the sentence and an indicator in the overlay class indicating supplemental content.
29. The system of claim 23, wherein automatically selecting the chapter comprises: Means for determining a page number corresponding to a user's progress in an electronic book based on a last displayed page of text of the electronic book.
30. The system of claim 23, further comprising means for generating at a user device a selectable indicator embedded in an electronic book display on the same page as the portion of text, wherein the selectable indicator, when selected, causes an associated media item to be displayed at the user device from a point corresponding to the selected portion of text.
31. The system of claim 23 further includes means for displaying, at a user device, (a) associated media items from a point corresponding to the selected portion of text and (b) displaying a selectable option for returning to the portion of text.
32. The system of claim 23 or 27, wherein displaying the associated media item at the user device or the second user device further comprises: Means for determining whether the associated media item can be displayed based on the content control.
33. The system of claim 23, wherein the associated media item comprises a movie version of an electronic book.
34. A non-transitory computer-readable medium having encoded thereon non-transitory computer-readable instructions for providing supplemental content accompanying an electronic book, comprising: instructions for receiving user input selecting a portion of text in an electronic book displayed on a user device; instructions for parsing the portion of text at a user device to determine keywords in the portion of text; instructions for retrieving, at a user device, a manifest file for an electronic book, wherein the manifest file indicates a title of the electronic book and a chapter of the electronic book from which the portion of text was selected, wherein the chapter includes percentage information of progress toward completion of the electronic book; instructions for automatically selecting, at a user device, the title as a first condition based on a manifest file; instructions for automatically selecting, at a user device, the chapter including the percentage information based on a manifest file as a second condition; instructions for automatically selecting, at a user device, a keyword as a third condition from chapter summary information corresponding to a chapter of the electronic book from which the portion of text was selected; instructions for generating, at a user device, a query for supplemental content based on the keyword, the first condition, the second condition, and the third condition; instructions for sending the query from a user device to a remote media database, wherein the remote media database is searched for supplemental content items that match the keyword, the first condition, the second condition, and the third condition, the supplemental content items comprising associated media items, wherein content of the associated media items is contextually relevant to content of the electronic book; instructions for receiving, at a user device, the associated media items; matching the percentage information to a point in the associated media item corresponding to the portion of the selected text in the electronic book; as well as Instructions for displaying, at a user device, the associated media item from a point corresponding to the portion of text selected in the electronic book.
35. The non-transitory computer readable medium of claim 34, further comprising instructions for filtering search results based on a fourth condition, wherein the fourth condition is based on at least one of: the page number of the portion of text indicated by the manifest file; the line number of the portion of text indicated by the manifest file; the segment number of the portion of text indicated by the manifest file; the scene of the portion of text indicated by the manifest file; as well as An electronic bookmark for the portion of text indicated by the manifest file.
36. The non-transitory computer readable medium of claim 34, further comprising: Instructions for automatically selecting, at the user device, a fifth condition for filtering search results, wherein the fifth condition is based on a version of a movie associated with the electronic book.
37. The non-transitory computer-readable medium of claim 34, further comprising instructions for identifying the portion of text by receiving user input to highlight the portion of text by generating an EPUB overlay class for the portion of text.
38. The non-transitory computer readable medium of claim 34, further comprising: instructions for providing a selectable option for sharing the supplemental content with a second user device; as well as In response to receiving user input selecting the selectable option, instructions are provided for displaying, on the second user device, the associated media item from a point corresponding to the selected portion of the text.
39. The non-transitory computer readable medium of claim 34, further comprising: Instructions for determining sentences in the electronic book that correspond to the supplemental content; as well as Instructions for applying visual highlighting to the sentence by generating an EPUB overlay class for the sentence and an indicator in the overlay class indicating supplemental content.
40. The non-transitory computer readable medium of claim 34, wherein the instructions for automatically selecting the chapter include: Instructions for determining a page number corresponding to a user's progress in the electronic book based on a last displayed page of text of the electronic book.
41. The non-transitory computer-readable medium of claim 34, further comprising instructions for generating, at a user device, a selectable indicator embedded in an electronic book display on the same page as the portion of text, wherein the selectable indicator, when selected, causes an associated media item to be displayed at the user device from a point corresponding to the selected portion of text.
42. The non-transitory computer-readable medium of claim 34 further comprising instructions for displaying, at a user device, (a) associated media items from a point corresponding to the selected portion of text and (b) displaying a selectable option for returning to the portion of text.
43. The non-transitory computer readable medium of claim 34 or 38, wherein the instructions for displaying the associated media item at the user device or the second user device further comprise: Instructions for determining whether an associated media item can be displayed based on the content control.
44. The non-transitory computer-readable medium of claim 34, wherein the associated media item comprises a movie version of an electronic book.
Citation Information
Patent Citations
Systems and methods for interactive program guides with personal video recording features
US20020174430A1
Interactive television program guide system having multiple devices within a household
US20050251827A1
Systems and methods for interacting with advanced displays provided by an interactive media guidance application
US20100153885A1
Method and system for simultaneously displaying a television program and information about the program
US6239794B1
Program guide system with browsing display
US6564378B1