Voice-Triggered Media Queries Using Playback Timing Context
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for obtaining additional information about media content during viewing are time-consuming and disrupt the viewing experience, often requiring users to pause or miss portions of the media to perform manual searches.
Innovation Solution
A system and method that utilizes a mobile device to associate with a media playback device, activate a microphone to capture ambient sounds, convert them to text inputs, and initiate a query based on trigger terms, performing a search using media playback information and timing data to provide search results on the mobile device or playback device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If manual search methods are used to find information about media content, then the user can obtain additional information, but the user must pause or miss portions of the media content and spend significant time on the search process
Solution Approach 1:
The system performs preliminary actions by automatically capturing media content information (such as audio tracks, video metadata, and content identification) in advance during media playback. This pre-captured information is stored and readily available when a user initiates a search, eliminating the need for manual searching through the media content itself and significantly reducing search time.
Solution Approach 2:
The system introduces an intermediary search processing system that acts as a mediator between the user's search query and the media content information. This intermediary system automatically processes search queries by retrieving relevant information from the pre-captured media metadata and presenting it to the user, thereby eliminating the need for the user to manually navigate through the media content to find information.
2Loss of information
If manual search methods are used to find information about media content, then the user can obtain additional information, but the viewing experience is disrupted and the user must pause the media content
Solution Approach 1:
The system performs preliminary actions by automatically capturing media content information (such as audio tracks, video metadata, and content identification) in advance during media playback. This pre-captured information is stored and readily available when a user initiates a search, eliminating the need for manual searching through the media content itself and significantly reducing search time.
Solution Approach 2:
The system introduces an intermediary search processing system that acts as a mediator between the user's search query and the media content information. This intermediary system automatically processes search queries by retrieving relevant information from the pre-captured media metadata and presenting it to the user, thereby eliminating the need for the user to manually navigate through the media content to find information.
3Loss of information
If the user searches through webpages and scans through pages to find information about an actor, then the user can obtain detailed information, but the procedure is time-consuming and may cause the user to miss substantial portions of the television program
Solution Approach 1:
The system performs preliminary actions by automatically capturing media content information (such as audio tracks, video metadata, and content identification) in advance during media playback. This pre-captured information is stored and readily available when a user initiates a search, eliminating the need for manual searching through the media content itself and significantly reducing search time.
Solution Approach 2:
The system introduces an intermediary search processing system that acts as a mediator between the user's search query and the media content information. This intermediary system automatically processes search queries by retrieving relevant information from the pre-captured media metadata and presenting it to the user, thereby eliminating the need for the user to manually navigate through the media content to find information.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates efficient and uninterrupted access to additional media content information by automating the search process, allowing users to retrieve information without pausing or missing media content.
Implementation Method 1
converting the received ambient sounds to one or more text inputs
Data Source
AI summary
Methods, systems, and media for processing queries relating to presented media content are provided. In some implementations, a method comprises: receiving a request to associate with a media playback device that is presenting media content to a user of the mobile device; activating a microphone associated with the mobile device; converting the received ambient sounds to one or more text inputs; in response to determining that a trigger term has been included in the text inputs, determining the media playback information from the media application that includes timing information corresponding to when a query was received; causing a search to be performed that includes the query, the timing information, and the media content identification information; obtaining a search result that is responsive to the query; and presenting at least a portion of the search result to the query on a mobile display associated with the mobile device.