Automatic detecting and recognizing method of scroll captions in videos

A technology of scrolling subtitles and automatic detection, applied in character and pattern recognition, instruments, computing and other directions, can solve the problem of ignoring video scrolling subtitles, and achieve the effect of avoiding repeated recognition, improving recognition effect, and low repetition rate

Active Publication Date: 2014-12-24
PEKING UNIV
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the existing methods only deal with the fixed subtitles in the video, ignoring the rolling subtitles in the video

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic detecting and recognizing method of scroll captions in videos
  • Automatic detecting and recognizing method of scroll captions in videos
  • Automatic detecting and recognizing method of scroll captions in videos

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0029] A method for detecting and identifying rolling subtitles in a video of the present invention, its simple flow chart is as follows figure 1 As shown, the more specific process is as follows figure 2 As shown, it specifically includes the following steps:

[0030] 1. Video subtitle detection and positioning

[0031] Video subtitle detection and positioning mainly detects whether the video frame contains subtitles, and locates the position of the subtitle text area. It mainly includes two steps: cumulative edge map generation and text area positioning and filtering. The specific methods of these two steps are introduced below.

[0032] Edge detection is the first step in video text detection and recognition. In order to obtain better edge intensity maps, we adopt the method of cumulative edge map generation to obtain edge in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an automatic detecting and recognizing method of scroll captions in videos and belongs to the field of video retrieval. The automatic detecting and recognizing method includes steps of (1) detecting a scroll caption area; (2) filtering the detected vertical scroll caption area by a self-adaption detecting window so as to reduce repetition rate of caption recognition; (3) stitching multiframe images comprising horizontal captions into a frame of images comprising a complete scroll caption, inputting the frame of images as OCR (optical character recognition) software after binaryzation and recognizing the captions. Kinetic characteristics of the scroll captions in videos are sufficiently taken into consideration, fixed captions and scroll captions in the videos can be differentiated, the horizontal scroll captions are stitched, and the vertical scroll captions are filtered by the caption selection area algorithm. Accordingly, better recognition performances including higher recall ratio, precision ratio and lower repetition rate are obtained, and action of the scroll caption information of the videos in video retrieval is sufficiently given into play.

Description

technical field [0001] The invention belongs to the technical field of video content retrieval, and in particular relates to a method for detecting and identifying rolling subtitles in a video. Background technique [0002] With the rapid development of Internet technology and multimedia technology, a large amount of video content has appeared on the Internet. In addition, business units such as TV stations and multimedia applications such as digital libraries, distance learning, and video-on-demand have also produced a large amount of video materials. Faced with such a massive amount of video data, how to analyze and retrieve it so that users can quickly retrieve the desired content has become an urgent problem to be solved. The traditional method is based on manually tagged keywords for retrieval. Due to the shortcomings of strong subjectivity and manual tagging, this method cannot be applied to the retrieval and management of massive video content. A large number of vid...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/435H04N21/235G06K9/00
Inventor 汪阳张健
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products