Hand Gesture Animation Playback in Live Stream Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network live stream interactions are limited, with anchor users primarily interacting with viewing users through comment messages, leading to a lackluster and unengaging experience for viewing users.
Innovation Solution
A hand-gesture-based interaction method and apparatus that allows anchor users to perform hand gestures recognized by the system, which then triggers the playback of corresponding hand gesture animations on both the anchor user's and viewing users' clients, enabling interactive elements like target pages for enhanced user engagement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hand gesture recognition and animation playback system is implemented, then user engagement and interaction quality are improved, but device complexity and processing requirements increase
Solution Approach 1:
The system captures the anchor user's hand gestures and creates animated copies that are transmitted to viewing users' devices. Instead of directly streaming complex gesture data, the system generates simplified animation representations that replicate the essential visual information, reducing processing requirements while maintaining engagement quality.
Solution Approach 2:
A server acts as an intermediary between the anchor user's client and viewing users' clients. The server receives gesture data, processes it into animation format, and distributes it to viewers. This intermediary architecture distributes computational complexity across multiple components rather than concentrating it in single devices.
2Speed
If real-time hand gesture animation playback is implemented across multiple clients, then interaction responsiveness is improved, but network bandwidth and data transmission requirements increase
Solution Approach 1:
The system extracts only the essential visual information from hand gestures - specifically the animated representation of gesture movements - and transmits this extracted data to viewing users. Rather than transmitting complete video streams or detailed motion capture data, only the necessary animation elements are sent, reducing data volume while maintaining responsiveness.
Solution Approach 2:
The system transforms gesture data into animation parameters that can be efficiently transmitted and rendered. By changing the representation from raw gesture coordinates to animation playback parameters, the data becomes more compact and suitable for network transmission while preserving the essential interactive information.
3Stability of the object's composition
If hand gesture animation is displayed in synchronized areas on both anchor and viewing user clients, then interaction consistency is improved, but synchronization complexity and processing overhead increase
Solution Approach 1:
The server receives status information from both the anchor user's client and viewing users' clients regarding animation playback state. This feedback mechanism allows the server to monitor and coordinate synchronization across devices, maintaining interaction consistency while distributing the synchronization management burden to the central server rather than requiring complex peer-to-peer coordination.
Data Source
AI summary
The present disclosure relates to a hand-gesture-based interaction method and apparatus, and a client. The method includes: in a live stream process of one network live stream, when a function of playback of a hand gesture animation is in an activated state, a client of an anchor user recognizes a hand gesture of the anchor user. When a hand gesture category matches a preset category of the hand gesture animation, the client of the anchor user plays back the hand gesture animation in a first area corresponding to a hand gesture position, and transmits a first content to a client of a viewing user through a first server. The client of the viewing user, based on the first content, plays back the hand gesture animation in a second area corresponding to the hand gesture position, and detects a trigger operation on the second area.