Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A kind of adaptive video coding method and terminal

A video coding and self-adaptive technology, applied in the direction of digital video signal modification, image communication, selective content distribution, etc., can solve the problem that the video coding technology cannot truly reflect the user's interest area, and achieve a good visual experience

Active Publication Date: 2019-04-05
北京安信智通科技有限公司
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In order to solve the problem that the ROI video coding technology in the prior art cannot truly reflect the real ROI of the user, the present invention provides an adaptive video coding method and a terminal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A kind of adaptive video coding method and terminal
  • A kind of adaptive video coding method and terminal
  • A kind of adaptive video coding method and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] figure 1 It is a flowchart of the adaptive video coding method in Embodiment 1, and the adaptive video coding method includes:

[0056] Step 101, the first terminal learns the attention area of ​​the second terminal user on the screen of the second terminal;

[0057] Step 102, determining the ROI and the non-ROI NROI in the video frame collected by the first terminal according to the ROI;

[0058] Step 103, the first terminal performs video coding on the collected video frame data according to the ROI and NROI so that the code rate of the macroblock set in the ROI in the video stream after video coding is greater than the code rate of the macroblock set in the NROI; The first terminal encapsulates the encoded video stream and sends it to at least one terminal including the second terminal that has a video call connection with the first terminal.

[0059] The specific execution mode of each step in the above-mentioned method is described in detail below:

[0060] In s...

Embodiment 2

[0077] Figure 4 It is a structural diagram of the terminal in the second embodiment. The terminal includes: an area of ​​interest analysis module, an area of ​​interest analysis module, an acquisition module, an encoding module, an encapsulation module, and a sending module.

[0078] The focus area analysis module is used to learn the focus area of ​​the peer user of the terminal on the peer screen;

[0079] The region of interest analysis module is used to determine the region of interest ROI and non-interest region NROI in the video frame collected by the terminal according to the region of interest;

[0080] The collection module is used to collect video frame data;

[0081] The encoding module is used to carry out video encoding to the collected video frame data according to the ROI and NROI so that the code rate of the macroblock set in the ROI in the video stream after video encoding is greater than the code rate of the macroblock set in the NROI;

[0082] The encaps...

specific Embodiment 1

[0098] Step 1001, the first terminal establishes a video call connection with the second terminal, and the first terminal and the second terminal exchange their respective screen information during the process of establishing the video call connection, including screen size, screen resolution, and screen orientation.

[0099]Step 1002, the first terminal detects the human eye movement track and the pupil state change track on the video frame data received from the second terminal, if no valid track can be detected, the first terminal sets the preset area (for example, the middle area {(x ,y)|W / 4<x<3W / 4,H / 4<y<3H / 4}) The macroblock set to which it belongs is taken as ROI, and the rest of the macroblock sets are taken as NROI. If an effective trajectory is detected, calculate the focus area of ​​the second terminal's viewer on its screen according to the detected human eye movement trajectory and pupil state change trajectory, and then watch the second terminal according to the sc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an adaptive video coding method and a terminal. The method comprises the steps: a first terminal learns a region concerned by a user of a second terminal in a screen of the second terminal, and according to the region concerned, determines a region of interest ROI and a non-region of interest NROI in a video frame acquired by the first terminal; the first terminal performs video coding for acquired video frame data according to the ROI and the NROI to realize that a code rate of a macro block set in the ROI is greater than the code rate of the macro block set in the NROI in the coded video stream; and the first terminal performs video stream encapsulation after video coding, and further sends the encapsulated data to at least one terminal comprising a video call connection with the first terminal, wherein the at least one terminal includes the second terminal. The method provided by the invention can truly reflect a true region of interest of a user of an opposite terminal in a process of performing video call by the terminal, and provides good video call visual experience for the user.

Description

technical field [0001] The invention relates to a video call technology, especially a technology based on automatic analysis of an area of ​​interest of a second terminal user and adaptive encoding of terminal video images, which can be applied to the fields of one-to-one video calls and multi-party video calls. Background technique [0002] With the continuous improvement of the Internet and mobile Internet infrastructure, as well as the upgrading of cellular mobile communication networks, people are increasingly using video calls or video calls as a means of long-distance communication in their lives and work. However, due to various factors such as insufficient network bandwidth, excessive network transmission load, and continuous improvement of video image resolution, traditional video coding technology cannot guarantee users to obtain high-quality video images. After years of development, video coding technology is gradually approaching the limit of compression ratio. H...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/4402H04N21/4728H04N19/146H04N19/176
CPCH04N19/146H04N19/176H04N21/4402H04N21/4728
Inventor 代金良江周平徐家骏
Owner 北京安信智通科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com