Face Detection Stabilizes Video Chat Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handheld wireless communication devices experience unstable video image quality during video chat sessions due to relative movement between the camera and user, leading to reduced image stability and mobility limitations when trying to improve stability by mounting the device.
Innovation Solution
A handheld wireless communication device with a camera on the same side as the display screen, equipped with a video processor that detects face position and adjusts the image frame boundaries in real-time to center and stabilize the face image, using motion vectors to adjust margins and providing user options for selecting fixed positions, with visual or audio warnings for excessive movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If the device is mounted on a stable surface to improve image stability, then image quality is improved, but user mobility is reduced
Solution Approach 1:
The patent replaces the mechanical stabilization approach (mounting the device on a stable surface) with a digital/image processing approach. The video processor detects face positions in each frame and dynamically adjusts cropping boundaries to keep the face centered, achieving image stability without restricting user mobility. This substitution of mechanical system with electronic/digital system resolves the contradiction between image stability and user mobility.
2Stability of the object's composition
If the device is mounted at a fixed location to improve image stability, then image quality is improved, but the user cannot easily move outside the camera range
Solution Approach 1:
The patent implements a dynamic solution where the cropping boundaries are continuously adjusted based on real-time face detection. Instead of a fixed mounting location, the system dynamically repositions the visible frame to track the user's face movement, allowing the user to move freely while maintaining image stability and face centrality throughout the video chat session.
3Stability of the object's composition
If post-processing techniques are used to stabilize video, then image stability is improved, but live video chat is not suitable
Solution Approach 1:
The patent performs face detection and cropping boundary adjustment in real-time during video capture, before the video is transmitted or displayed. By implementing the stabilization process as a preliminary action during the capture phase rather than as post-processing, the system achieves image stability suitable for live video chat without significant time delays or buffering requirements.
Data Source
AI summary
A handheld communication device is used to capture a video and stabilize the video during a video chat session. The device has a camera to capture a video during a video chat session that is conducted between a user of the device and a far-end user. The video includes images frames, each of the image frames containing an image of a face of the user. The device detects the position of the face in each image frame. Based on the detected position of the face, a boundary area of each image frame is cropped to produce an output video while the video is being captured. The image of the face stays substantially stationary in the output video. The output video is transmitted to the far-end user during the video chat session. Other embodiments are also described and claimed.