Cartoon image layout recognition method and automatic recognition system

Abstract

The invention discloses a cartoon image layout recognition method and an automatic recognition system. According to the recognition method, by use of an energy minimization model and an image segmentation and optimization method, polygons constituting image storyboard frames are automatically recognized; a reading order of the image storyboards is obtained according to the geometric position relation of the recognized polygons; The recognition method comprises following steps: foreground and background segmentation, outline detection, polygon fitting, straight-line segment detection, storyboard searching, and reading order detection. The recognition system comprises a foreground and background segmentation module, an outline detection module, a straight-line segment detection module, a storyboard searching module, and a post processing module. According to the position relation of recognized polygons, the reading order of storyboards is determined so that complicated cartoon layouts can be effectively processed, the processing efficiency is increased, and the reading experience of mobile device users is enriched.

Description

technical field [0001] The invention belongs to the field of image processing and computer vision, and relates to a recognition method and an automatic recognition system of a cartoon image layout based on an energy minimization model. Background technique [0002] Mobile comics are a special type of publication, usually composed of simple and humorous picture groups and a small amount of text, and are loved by readers of different ages in different countries. In recent years, the trend of legalization of electronic comics and popularization of mobile comic reading is obvious. The comic digital publishing industry is facing new opportunities. At the same time, end users who pay to read comics have also put forward new requirements for comic content, comic quality and comic mobile reading experience. At present, there are not enough comic content optimized for mobile reading experience. Most comic content providers just scan existing paper comic publications page by page, sto...

AI Technical Summary

Problems solved by technology

However, this method is also unable to deal with complex comic images with glue between shots

[0005] To sum up, most of the existing manga layout analysis and recognition can only deal with relatively simple manga layouts, and some methods even have to rely on manual processing, but there is no efficient and general manga image layout analysis and recognition method and automatic recognition system

Images