Video Talk Enhancement Middleware for Frame Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video call technologies lack the ability to provide diverse and enhanced video talk experiences, particularly in modifying and transmitting frames during video calls to enhance user interaction and functionality.
Innovation Solution
A method and device that utilize a video talk enhancement function, which includes a video talk application, a middleware, and a processor to select and apply various enhancement modes such as screen share, skin beautifying, and video film modes, allowing for the modification and transmission of frames between devices during video calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video call applications are modified to provide enhanced functions, then video talk functionality is improved, but application complexity and modification difficulty increase
Solution Approach 1:
The patent introduces a middleware layer positioned between the video call application and the camera sensor. This middleware handles frame capture, enhancement mode selection, and frame transmission, allowing enhanced video talk functions to be added without modifying the existing video call application code. The middleware acts as an intermediary that processes camera frames and applies enhancements while the application continues to operate as before.
2Adaptability or versatility
If multiple enhancement modes are added to video talk, then user experience is improved, but system complexity increases
Solution Approach 1:
The middleware is designed with multi-functionality to handle various enhancement modes including screen sharing, skin beautification, and video film effects. Instead of creating separate applications or heavily modifying the video call application for each enhancement mode, the middleware provides a universal platform that can switch between different enhancement functions, reducing overall system complexity while maintaining versatility.
Solution Approach 2:
The system segments the video talk functionality into distinct modules: the original video call application, the middleware layer, and the camera sensor. Each component has a specific responsibility - the application handles call management, the middleware handles frame processing and enhancement mode selection, and the camera sensor captures frames. This segmentation allows enhancement modes to be added independently without affecting the core application structure.
3Adaptability or versatility
If frame modification is performed during video call, then video talk enhancement is achieved, but processing time increases
Solution Approach 1:
The middleware performs frame enhancement operations on captured camera frames before transmitting them to the display or other devices. By preprocessing frames in the middleware layer, the system avoids time-consuming modifications during the actual video call transmission, reducing latency and processing time impacts on the live video experience.
Data Source
AI summary
A method for performing a video talk enhancement (VTE) function in an electric device is provided. A video talk application performs a video call and receiving at least one first frame generated by a camera sensor from a middleware. The input unit receives an input signal to select one of several video talk enhancement modes provided by a video talk enhancement application. Under the video call, the middleware replaces the at least one first frame with a second frame(s) or modifying the at least one first frame according to the selected video talk enhancement mode. The video talk application transmits the modified at least one first frame or the second frame(s) to another electric device, so that the modified at least one first frame or the second frame(s) which is transmitted is shown on the another electric device as a video talk frame.