Intelligent TV Shopping System with Visual Search and Object Abstraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current TV shopping models face challenges due to awkward user interaction mechanisms, such as remote control difficulties, which disrupt the relaxed viewing experience and struggle to compete with online shopping via PCs or mobile phones.
Innovation Solution
An intelligent user-interaction control system that generates summary video frames, allows users to select objects of interest, and searches online databases for relevant information, using a data storage, object abstraction module, user experience handler, and visual search engine to provide seamless shopping integration with TV viewing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional remote control interaction is used for TV shopping, then TV shopping functionality is provided, but user interaction becomes awkward and disrupts the relaxed viewing experience
Solution Approach 1:
The system pre-generates summary video frames and objects of interest before user interaction is needed. When a user pauses the program, the system has already prepared the summary frames and identified key objects, enabling immediate presentation without requiring time-consuming processing during the interaction moment.
Solution Approach 2:
The system extracts and presents only the most relevant information (summary frames and key objects) from the full video content, separating essential shopping information from the complete program. This allows users to quickly review product details without watching the entire program, reducing interaction time while maintaining ease of operation.
2Productivity
If users are required to actively click buttons to lock in coupons during TV programs, then shopping functionality is achieved, but users are put into an alert mood that destroys the relaxed viewing experience
Solution Approach 1:
The system automatically performs shopping tasks for users based on their viewing behavior. When users pause the program or express interest in certain segments, the system automatically presents summary frames, identifies objects of interest, and facilitates purchasing without requiring users to actively click buttons or maintain alertness, thus preserving the relaxed viewing experience while maintaining shopping productivity.
3Adaptability or versatility
If downloadable applications are provided for TV shopping, then shopping functionality is extended to TV, but the difficulty of using TV remote controls prevents competition with online shopping via PCs or mobile phones
Solution Approach 1:
The system replaces complex mechanical remote control operations with automated electronic processing. Instead of requiring users to navigate through multiple menu layers and buttons on the remote control, the system uses automated frame summarization, object detection, and intelligent presentation of shopping information, substituting mechanical interaction with electronic intelligence to achieve PC-like shopping capability through TV.
Data Source
AI summary
A method for an intelligent user-interaction control system includes generating a plurality of summary video frames for a certain time of incoming bit-stream of a video program to be shown on a display, and detecting a hold command from a user to stop the video program. The method also includes presenting the plurality of summary video frames to the user on the display after stopping the video program, obtaining a user selection on a selected summary frame from the plurality of the summary video frames, presenting a plurality of objects of interest from the selected summary frame to the user on the display, and determining a user-selected object of interest from the plurality of objects of interest. The method also includes searching the selected object in an online database to obtain searching results corresponding to the selected object, and prompting the user about the searching results.