Terminal Video Synthesis via Facial Expression and Gesture Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current information processing methods for creating synthetic videos on terminals are complex and inefficient, requiring multiple interactions to add correlated information, leading to high processing costs and unsatisfactory results.
Innovation Solution
A method where a terminal detects facial expressions or gestures during media capture and sends this information to a server, which responds with corresponding media elements for real-time synthesis, eliminating the need for manual selection and placement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual selection and addition of information from material library is performed, then video synthesis can be achieved, but operation complexity increases and processing efficiency decreases
Solution Approach 1:
The system automatically detects facial expressions and gestures from the video content, and autonomously selects and adds corresponding information from the material library without requiring manual user intervention. This self-service mechanism resolves the contradiction by making the system operate itself, thereby simplifying user operation while maintaining high processing efficiency
Solution Approach 2:
The system pre-establishes a material library containing various types of information (text, images, videos) that can be correlated with video content. By preparing these materials in advance and organizing them for automatic retrieval, the system enables rapid automated synthesis without manual selection, thus improving both ease of operation and processing efficiency
2Reliability
If multiple interactions are performed to add correlated information, then video synthesis can be achieved, but time cost increases
Solution Approach 1:
The system employs real-time feedback mechanisms where facial expression recognition and gesture recognition continuously monitor the video content and automatically trigger the addition of corresponding information from the material library. This feedback-driven automated process eliminates the need for multiple manual interactions, maintaining high synthesis quality while dramatically reducing processing time
Solution Approach 2:
The patent replaces the manual mechanical interaction process with an automated recognition and synthesis system. By using facial expression recognition technology and gesture recognition technology to automatically identify and add correlated information, the system substitutes manual operations with automated mechanical processes, thereby reducing time cost while maintaining synthesis quality
3Ease of operation
If automated facial expression and gesture detection is implemented, then operation complexity is reduced, but device complexity increases
Solution Approach 1:
The patent introduces an intermediary information processing system that includes facial expression recognition modules and gesture recognition modules. These intermediaries bridge the gap between simple user operation and complex automated synthesis by automatically detecting facial expressions and gestures, then translating them into appropriate information selection and video synthesis operations, thereby reducing operational complexity while managing device complexity through modular design
Data Source
AI summary
A method of performing video synthesis by a terminal is described. Circuitry of the terminal receives a first operation to trigger capture of first media information and detects at least one of a facial expression change of a user based on a first preset condition or a gesture of the user based on a second preset condition during the capture of the first media information. The circuitry of the terminal sends the detected at least one of the facial expression change or the gesture of the user to a server as key information. The circuitry of the terminal receives second media information that corresponds to the key information from the server and performs video synthesis on the first media information and the second media information.