Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Reinforcement learning based automatic picture cutting method and device

A technology of reinforcement learning and image processing, which is applied in the field of image processing, can solve problems such as cropping window cannot be covered, consumes computing resources, and cropping effect is not good, so as to achieve the effect of reducing the time required for computing, flexible clipping process, and reducing the amount of calculation

Active Publication Date: 2018-06-12
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF6 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method will generate a large number of candidate windows, and the shape and size of each candidate window are relatively fixed. The cropping window with a fixed shape and size cannot cover all situations, so not only the cropping effect is not good, but also it will consume a lot of calculations. resources and longer

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reinforcement learning based automatic picture cutting method and device
  • Reinforcement learning based automatic picture cutting method and device
  • Reinforcement learning based automatic picture cutting method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0054] In the present invention, a sorting model and a reinforcement learning model are designed, and the reward function is set based on the quality scores of the pictures before and after cropping obtained by the sorting model, and the reinforcement learning model is trained according to the reward function, so as to obtain a cropping strategy for improving the aesthetic quality of the picture, and finally according to The clipping strategy and the current state represent the serialized execution of the corresponding clipping actions, and finally obtain high-quality clipping results.

[0055] The method for automatically cropping pictures ba...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a reinforcement learning based automatic picture cutting method and device, relates to the field of image processing, and aims at obtaining an accurate picture cutting result rapidly. The method comprises the steps that a reinforcement learning model is used to carry out feature extraction on a present cutting window to obtain a local feature, the local feature is spliced toa global feature of the picture to be cut to obtain a new characteristic vector, and the new characteristic vector serves as present observation information; historical observation information obtained via the reinforcement learning model and the present observation information are combined and serve as present state representation; and according to a cutting strategy and the present state representation, a cutting motion is carried out on the picture to be cut sequentially, and a cutting result is obtained. The reinforcement learning model is a model which is established on the basis of a convolutional neural network. The method and device can be used to obtain the accurate picture cutting result rapidly.

Description

technical field [0001] The invention relates to the field of image processing, in particular to a method and device for automatically cropping pictures based on reinforcement learning. Background technique [0002] With the rapid development of the image processing field, image automatic cropping, as an important part of the image processing field, has also been greatly improved. Image automatic cropping requires the computer to automatically pick out well-composed regions from the input image, which have higher aesthetic quality than the original image. [0003] The traditional method is based on the sliding window method, which mainly extracts candidate regions through sliding windows, and then extracts features from each candidate region and scores them, and the region with the highest score is used as the final result. However, this method will generate a large number of candidate windows, and the shape and size of each candidate window are relatively fixed. The croppin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T3/00G06T7/11G06N3/04
CPCG06T7/11G06T2207/20081G06T2207/10004G06T2207/20132G06N3/045G06T3/04
Inventor 黄凯奇张俊格李德榜
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products