Audio Keyword Matching for Display Content Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In environments where both music and video content are played, such as shopping malls or airport lounges, existing systems often present uncoordinated auditory and visual services, leading to a poor user experience due to the lack of synchronization between music and video content.
Innovation Solution
A content pushing method for display devices that detects audio in the environment, extracts keywords from the music, matches them with a database to identify relevant content, and synchronizes visual content display with the audio, using feature vectors, audio segment recognition models, and keyword recognition models to ensure relevance and coherence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If independent music and video systems are used, then system complexity is reduced, but content relevance deteriorates
Solution Approach 1:
The patent merges the music system and video system into an integrated system where a central processor coordinates both audio and visual content delivery. The processor detects music information, extracts keywords, matches them with video content, and pushes relevant videos to display devices, ensuring content relevance while maintaining manageable system complexity through centralized control.
2Loss of information
If audio content is detected and matched with video content, then content relevance is improved, but processing complexity increases
Solution Approach 1:
The patent introduces an intermediary processor that acts as a mediator between the music detection system and the video content delivery system. This processor extracts keywords from detected music, matches them with video content in a database, and pushes relevant videos to display devices. The intermediary simplifies the overall processing complexity by centralizing the matching logic and using keyword-based search rather than complex real-time analysis.
3Reliability
If real-time audio detection and content matching is implemented, then user experience is improved, but response time increases
Solution Approach 1:
The patent implements preliminary action by pre-storing video content and their associated keywords in a database before runtime. When music is detected, the system quickly retrieves and matches video content based on pre-extracted keywords rather than analyzing video content in real-time. This approach maintains good user experience through relevant content matching while minimizing response time by avoiding complex real-time video analysis.
Data Source
AI summary
The present disclosure provides a content pushing method and device for a display device and a display device. The content pushing method includes: detecting audio in an environment; acquiring at least one keyword of the audio; acquiring a content to be displayed associated with the keyword of the audio; and pushing the content to be displayed to the display device to display the content to be displayed.