Unlock instant, AI-driven research and patent intelligence for your innovation.

ROI-based video coding method and system and video transmission and coding system

A technology of video coding and coding, which is applied in closed-circuit television systems, video conference systems, two-way working systems, etc., can solve problems such as failure to achieve satisfactory results, reduce user visual experience, and fail to improve the subjective visual quality of pictures.

Active Publication Date: 2020-07-24
北京奥维视讯科技有限责任公司
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, such ROI selection results have the following disadvantages: First, the fixed ROI area is not completely consistent with the ROI concerned by the application in the time-varying video image, which cannot achieve the purpose of improving the subjective visual quality of the picture; secondly, the fixed ROI area Instead, it degrades the user's visual experience during video playback
However, ROI area selection based on traditional image segmentation technology, target tracking and target recognition technology cannot achieve satisfactory results in actual video coding applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • ROI-based video coding method and system and video transmission and coding system
  • ROI-based video coding method and system and video transmission and coding system
  • ROI-based video coding method and system and video transmission and coding system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0134] Image 6 A real-time video encoding method 400 according to Embodiment 1 of the present invention is shown. The system is a real-time video communication / recording system for adaptively extracting ROI with the following characteristics: the background is relatively fixed, and the panorama is dominated by head-and-shoulders sequences or other moving objects. The method 400 includes:

[0135] In step S401, a basic DNN model and a training framework are selected, and a DNN model without motion estimation information and a DNN model combined with motion estimation information are established according to the basic DNN model.

[0136] In step S402, the following types of short videos are selected to form the original training set: video conference content, live video content, video surveillance content, and news broadcast content; foreground and background are marked. Based on the original training set, establish a training set for labeling ROI areas and a training set for...

Embodiment 2

[0142] Figure 7 The second preferred embodiment according to the present invention is shown, which specifically relates to a video transmission and encoding system 500, which includes a camera 501 and the above-mentioned video encoding device 300. The camera 501 is configured to collect images in real time, and the video frame acquisition unit 301 of the video encoding device 300 communicates with the camera 501 to obtain the images captured by the camera in real time as the video to be encoded, and use the neural network model to process the image Perform ROI identification and extraction, and encode according to the ROI extraction results, and then use it for transmission or storage. Additionally preferably, the video transmission and encoding system 500 may further include a camera control mechanism 502, which is connected to the camera and can control the angle and / or focal length of the camera. For example, a preset area can be set in the field of view of the camera 501...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a ROI-based video coding method. The method comprises the following steps: S101, acquiring a video frame of a to-be-coded video; s102, extracting an ROI area of the video framethrough a neural network model; s103, for the ROI area of the video frame, carrying out coding in a first coding mode; and for the non-ROI area of the video frame, adopting a second coding mode for coding, wherein the coding image quality level of the first coding mode is higher than that of the second coding mode. The invention further discloses a ROI-based video coding device and a video transmission and coding system.

Description

technical field [0001] The present invention generally relates to the technical field of image processing, and in particular to an ROI-based video encoding method, an ROI-based video encoding system, and a video transmission and encoding system. Background technique [0002] As the current mainstream video coding technology, hybrid video coding combines transform coding and predictive coding to form a new type of so-called hybrid coding. Usually, frequency domain transforms such as DCT and wavelet transform are used to compress spatial redundancy. Techniques such as intra-frame prediction and inter-frame prediction with motion compensation perform temporal redundancy compression to achieve higher compression efficiency for video data. The early ITU video conference and video telephone image compression coding standards suggested H.261 and subsequent ISO / IEC MPEG-1, MPEG-2, MPEG-4, H.264, HEVC and domestic video coding standard AVS and other video compression coding standards...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N19/167H04N19/154H04N7/18H04N7/15H04N21/2187G06N3/04
CPCH04N19/167H04N19/154H04N7/18H04N7/15H04N21/2187G06N3/04
Inventor 王宇宗文
Owner 北京奥维视讯科技有限责任公司