Cross-Screen Synchronization via Prompt Message Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia content cross screen synchronization technologies face challenges in accurately recognizing TV content due to ambient noise interfering with voiceprint recognition and image recognition errors caused by ambient light and background factors, leading to focus issues during image capture.
Innovation Solution
A multimedia content cross screen synchronization apparatus and method that uses a display device to provide multiple stream channels with prompt messages prompting specific user behaviors, which are sensed by a mobile device and translated into feedback signals to select corresponding application services from a server, enabling accurate cross screen synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If voiceprint recognition is used to determine TV content, then the system can identify the currently viewed program, but ambient sound interference causes determination errors
Solution Approach 1:
The patent introduces an intermediary mechanism (prompt message system) between the TV content and the mobile device. Instead of directly recognizing TV audio/video content, the system uses pre-defined prompt messages displayed on TV that users interact with via mobile device, thereby avoiding direct exposure to ambient noise interference while still achieving content identification.
Solution Approach 2:
The patent replaces the acoustic recognition system (voiceprint recognition vulnerable to ambient noise) with an optical-electronic interaction system. Users scan prompt messages displayed on TV using mobile device cameras, converting acoustic-based recognition into optical-based recognition, which is not affected by ambient sound.
2Measurement precision
If image recognition is used to determine TV content, then the system can identify the currently viewed program, but ambient light and TV background cause recognition errors
Solution Approach 1:
The patent applies local quality by designing prompt messages with distinct visual characteristics (specific colors, patterns, or formats) that differ from the general TV background. This localized visual differentiation ensures that the recognition system can distinguish the prompt message from ambient TV content and lighting conditions.
3Measurement precision
If TV images are captured for recognition, then the system can analyze the displayed content, but hand shake during capturing causes focus errors
Solution Approach 1:
The patent transitions from direct TV screen capture (2D plane with focus requirements) to QR code-based identification (2D pattern recognition). The mobile device camera captures the QR code displayed on TV, and the system recognizes content through pattern matching rather than traditional image focusing, eliminating focus errors caused by hand shake.
Data Source
AI summary
A multimedia content cross screen synchronization apparatus and method, and a display device and a server are provided. The apparatus includes the display device and the server. The display device provides a plurality of stream channels to a user to select and watch. Each of the stream channels displays a multimedia content. The multimedia contents of at least two channels of the stream channels contain different prompt messages. These prompt messages prompt the user to perform different corresponding behaviors. The mobile device senses a behavior of the user and generates a feedback signal corresponding to the behavior to the server. The server selects a corresponding application service from a plurality of application services according to the feedback signal transmitted from the mobile device, and provides the corresponding application service to the mobile device.