Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Spatially adaptive video coding

A coding and spatial technology, applied in image coding, digital video signal modification, instruments, etc., can solve problems such as packet loss, distortion, delay, etc.

Inactive Publication Date: 2015-11-04
MICROSOFT TECH LICENSING LLC
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the channel conditions will not support the bit rate, this may incur other distortions, e.g. due to packet loss or delay

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatially adaptive video coding
  • Spatially adaptive video coding
  • Spatially adaptive video coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] At low bit rates, it may be beneficial to reduce the video resolution to reduce the distortion introduced by encoding. Frames can contain objects with different resolution sensitivities, such as faces in the foreground and less important backgrounds. When reducing the resolution, important details in the face as well as communication cues can be lost. Therefore, it may be beneficial to give faces a higher resolution compared to the background.

[0016] One option could be to transmit two separate streams with different resolutions. This can be complex in terms of implementation, and it might not be very efficient either.

[0017] According to an embodiment of the present disclosure, the solution is to "warp" the video frame at the sender side such that faces or other regions of interest (ROIs) are stretched out while the background is reduced. In an embodiment, the output may be a rectangular frame suitable for encoding with an existing encoder standard such as H.264...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A video signal comprises a sequence of source frames to be encoded. A pre-processing stage determines a region of interest for a plurality of the source frames, and spatially adapts each of the plurality of the source frames to produce a respective warped frame. In the respective warped frame, the region of interest comprises a higher spatial proportion of the warped frame than in the source frame. The pre-processing stage supplies the warped frames to an encoder to be encoded into an encoded version of the video signal.

Description

Background technique [0001] In modern communication systems, video signals can be sent from one terminal to another over a medium such as a wired and / or wireless network (usually a packet-based network such as the Internet). For example, video may form part of a live video call such as a VoIP call (Voice over Internet Protocol). [0002] Frames of video are typically encoded at the transmitting terminal by an encoder in order to compress them for transmission over a network. Encoding for a given frame may include intra-coding, where blocks are encoded relative to other blocks in the same frame. In this case, the block is coded in terms of the difference (residual) between the block and neighboring blocks. Alternatively, encoding for some frames may involve inter-coding, where each block in the target frame is encoded relative to a corresponding portion in a previous frame, typically based on motion prediction. In this case, the block is identified in terms of the motion vec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/00G06T3/40H04N19/117H04N19/167H04N19/172H04N19/85H04N19/119H04N19/59
CPCH04N19/00903G06T3/0006G06T3/0012G06T3/0056G06T3/0093G06T3/4007H04N19/117H04N19/119H04N19/167H04N19/172H04N19/59H04N19/85G06T3/10G06T3/18G06T3/02G06T3/04G06T3/40G06T9/00
Inventor D.赵S.尼基富罗夫K.霍夫鲍尔M.亨门多夫P.卡尔松
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products