Unlock instant, AI-driven research and patent intelligence for your innovation.

Image Stabilization Based on Depth Camera

An image collection and depth measurement technology, which is applied in image enhancement, image analysis, image communication, etc., and can solve problems such as shaking, non-optimal video content quality, and inter-frame jitter.

Active Publication Date: 2020-08-25
GOOGLE LLC
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, often the quality of video content recorded by users is sub-optimal
For example, a video camera may shake and cause frame-to-frame jitter visible in the video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image Stabilization Based on Depth Camera
  • Image Stabilization Based on Depth Camera
  • Image Stabilization Based on Depth Camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Aspects and embodiments of the present disclosure relate to depth camera based image stabilization. Cameras that capture a video's image sequence can be shaky and can cause frame-to-frame jitter visible in the video. A video frame is one of many still images that make up a moving picture (hereinafter referred to as "video"). Jitter refers to vibrations in a component or, for example, the result of an unsteady hand of a user of a source device capturing video.

[0024] Accordingly, described herein, in various implementations, are techniques that enable real-time depth camera-based image stabilization. For example, the disclosed embodiments may be applied to, for example, communication via video messaging applications, audio and / or video conferencing, audio and / or video chat, audio and / or video conference rooms, audio and / or video chat rooms, etc. Video communications between users, where the video communications are sent and / or received by one or more users' devices i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The processing device collects depth data for frames in the image sequence of the video stream provided by the source device to the target device as part of the communication session. Depth data is created by the source device's depth-aware camera. The processing device uses the depth data to map the feature positions of the features of the objects in the frames to the feature positions of the features of the objects in other frames, uses the mapped feature positions to determine overlapping frame blocks between the frames, based on The overlapping frame block modifies the set of images corresponding to the frames in the image sequence to create a steady stream of images in the video stream, and provides the steady stream of images in the video stream as part of the communication session.

Description

technical field [0001] Aspects and embodiments of the present disclosure relate to image stabilization, and more particularly to depth camera based image stabilization. Background technique [0002] Recording a video and sharing it with your friends has become the accepted norm in social communication today. Various handheld devices such as mobile phones, eyeglasses, etc. are equipped with video cameras which allow users to record video and share it with their friends and family. Video cameras can also be used to enable video collaboration (eg, video chat, video conferencing, telemedicine, etc.) over the Internet. Often, however, the quality of user-recorded video content is sub-optimal. For example, a video camera may shake and cause frame-to-frame jitter visible in the video. Contents of the invention [0003] The following presents a simplified summary of various aspects of the disclosure in order to provide a basic understanding of these aspects. This summary is no...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N5/232
CPCH04N23/6811H04N23/6845H04N23/6812H04N23/68H04N23/611G06T2207/10028H04N5/2628H04N5/272G06T7/30G06T7/55
Inventor 格雷戈里·M·伯吉斯托尔·卡朋特
Owner GOOGLE LLC