Interactive Filters in Live Streaming via Computer Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current live streaming platforms lack interactive filter capabilities, requiring streamers to build custom computer vision applications, which is technically challenging and not viable for most users, and do not allow viewers to control when and which filters are applied, limiting interactivity and monetization opportunities.
Innovation Solution
A system and method for interactive filters in live streaming multimedia using local broadcasting software that captures and encodes video, uploads it to streaming services, and uses computer vision to detect objects, aligning filters with viewer interactions to insert graphical overlays dynamically into the video stream, allowing viewers to apply filters and increasing interactivity and monetization potential.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If streamers build custom computer vision applications to add interactive filters, then filter interactivity and viewer engagement are improved, but device complexity and development difficulty increase significantly
Solution Approach 1:
The patent introduces a third-party service as an intermediary that handles the complex computer vision processing and filter application. Instead of streamers building their own applications, they use this intermediary service that receives viewer commands, processes them through computer vision algorithms, and applies appropriate filters to the stream in real-time.
Solution Approach 2:
The system enables viewers to directly control filter application through the chat interface without requiring streamers to manually configure or code custom computer vision applications. The automated system serves itself by detecting viewer commands and automatically applying the appropriate filters based on the detected object or region.
2Manufacturing precision
If traditional video editing software is used, then video quality and edit precision are improved, but loss of time and inability to edit live content occur
Solution Approach 1:
The system transitions from static pre-rendered overlays to dynamic real-time filter application. Filters are applied live during the broadcast based on real-time computer vision detection of objects or regions in the stream, allowing immediate response to viewer interactions without time delay.
Solution Approach 2:
The system pre-loads multiple filter options and configurations before the broadcast. When a viewer command is received, the appropriate pre-prepared filter is immediately applied without needing to process or generate the filter effect in real-time from scratch, reducing the time delay between command and application.
3Ease of operation
If static overlays are used in streams, then ease of operation and simplicity are improved, but viewer engagement and interactivity are reduced
Solution Approach 1:
The system transforms static overlays into dynamic, interactive elements that respond to real-time viewer commands. Filters are applied based on detected objects or regions in the stream, creating an adaptive experience that engages viewers while maintaining operational simplicity through automated detection and application.
Solution Approach 2:
The system implements a feedback loop where viewer commands transmitted through the chat interface are received, processed by the computer vision system, and result in corresponding filter applications. This closed-loop feedback mechanism significantly increases viewer engagement and interactivity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables streamers to enhance their live streams with interactive filters, increasing viewer engagement and retention, and providing new monetization opportunities by placing control of filter application in viewers' hands, enhancing the overall streaming experience.
Implementation Method 1
the local broadcasting software configured to use computer vision to detect the position and orientation of an object in the user's local camera feed
Data Source
AI summary
This present disclosure describes a system and methods for interactive filters in live streaming multimedia. At least one method includes a user playing video games on a computer, using streaming software to combine all or part of their computer session with their local camera feed, using streaming software to encode and stream the encoded video to one or more streaming services, streaming services displaying the video stream to one or more viewers, said viewers interacting with the video via the streaming service, the user's streaming software retrieving data about viewer interactions, the streaming software using a computer vision algorithm to detect the position of an object in the user's camera feed, such as the user's face or hands, the streaming software retrieving animation code, the streaming software using the detected position of the detected object to generate a graphical image that aligns with and follows the detected object in the local camera feed, the streaming software adding the graphical image to the video stream in direct response to viewer interactions, and said graphical image being inserted into the video stream prior to the video being published for viewers to consume by the streaming service.