Dynamic Viewing Window for Mobile Video Stream Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video streams captured by mobile video capture devices often appear unstable due to motion, causing motion artifacts that affect the viewing experience on remote display devices such as head-mounted displays, cellular telephones, and other mobile devices.
Innovation Solution
The implementation of viewing windows within the video stream, which are spatial subsets that can be dynamically positioned based on motion and position data from sensors, such as accelerometers and gyroscopes, to dampen motion artifacts and allow control over the displayed portion of the video stream by either the person capturing or viewing the video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a mobile video capture device is used to capture video streams, then the video can be shared with remote display devices, but the video stream appears unstable due to motion of the person carrying the device
Solution Approach 1:
The patent applies dynamics by making the viewing window movable and adjustable within the video stream. The viewing window position is dynamically changed based on motion data from sensors (accelerometers, gyroscopes) to compensate for device movement. This allows the system to adapt to changing motion conditions while maintaining a stable viewing experience, resolving the contradiction between video sharing capability and video stream stability.
Solution Approach 2:
The patent changes the parameter of viewing window position within the video stream based on motion data. By adjusting the spatial coordinates of the viewing window according to sensor measurements of device movement, the system compensates for motion artifacts and maintains stability in the displayed video content while preserving the ability to share video streams.
2Area of stationary object
If the entire video stream is displayed on the remote display device, then the viewing area is maximized, but motion artifacts are more prominent and viewing comfort is reduced
Solution Approach 1:
The patent segments the video stream by displaying only a portion of it within a defined viewing window rather than the entire stream. This segmentation allows the system to focus on a specific area of interest and reduce motion artifacts in that region while maintaining an appropriate display area size. The viewing window acts as a selective frame within the larger video stream, isolating the harmful motion effects from the primary viewing content.
3Stability of the object's composition
If motion compensation is applied to the video stream, then motion artifacts are reduced, but the complexity of the system increases
Solution Approach 1:
The patent introduces an intermediary approach by using sensor data (accelerometer and gyroscope readings) as a mediator between the mobile video capture device and the remote display device. Instead of directly processing and correcting the entire video stream, the system uses sensor information to determine viewing window position adjustments, which is a simpler and more manageable approach to motion compensation that reduces system complexity while maintaining video stability.
Data Source
AI summary
Techniques are provided for viewing windows for video streams. A video stream from a video capture device is accessed. Data that describes movement or position of a person is accessed. A viewing window is placed in the video stream based on the data that describes movement or position of the person. The viewing window is provided to a display device in accordance with the placement of the viewing window in the video stream. Motion sensors can detect motion of the person carrying the video capture device in order to dampen the motion such that the video on the remote display does not suffer from motion artifacts. Sensors can also track the eye gaze of either the person carrying the mobile video capture device or the remote display device to enable control of the spatial region of the video stream shown at the display device.