Multimedia Interaction via Image Clip Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interaction methods for multimedia programs are inefficient due to tedious text editing operations, leading to low interaction efficiency among users.

Innovation Solution

A method involving a server and terminal device that receives image clip information from a playback device, determines matching multimedia program information, and sends interaction information to the terminal device to output an interactive interface, allowing users to interact with the program through simple operations such as voting, quizzes, or messaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users send short messages or leave messages at specified websites through text editing operations, then interaction can be achieved, but the operations are too tedious and interaction efficiency is very low

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidoperation simplicity
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent replaces manual text editing operations with automatic image recognition and processing systems. The terminal device captures images from the multimedia program, the server recognizes and processes these images to extract interaction information, eliminating the need for users to manually edit text and significantly improving interaction efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables automatic processing where the terminal device and server autonomously complete image capture, recognition, information extraction, and interaction interface generation without requiring user intervention in these automated processes, allowing users to simply view and interact with the generated interfaces

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10834479B2Interaction method based on multimedia programs and terminal device
Publication Date: 2020.11.10 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US10834479B2 patent drawing
  • US10834479B2 patent drawing
  • US10834479B2 patent drawing

AI summary

An interaction method based on multimedia programs, a terminal device, a server and a system are disclosed, which belong to the field of network technologies. The method includes: acquiring at least one image clip information of a multimedia program in a process of playing back the multimedia program; sending the image clip information, the image clip information being used for matching corresponding multimedia program information; receiving interaction information corresponding to the multimedia program information; and outputting an interactive interface, to interact with the multimedia program based on an interaction operation on the interactive interface. The present disclosure is easy to operate, and improves interaction efficiency.