Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for realizing interactive image segmentation, and terminal

An image segmentation and interactive technology, applied in the field of image processing, can solve problems such as many iterations, long algorithm running time, and affecting user experience

Active Publication Date: 2017-06-27
NUBIA TECHNOLOGY CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] When using the GrabCut algorithm for image segmentation on a mobile phone, in order to reduce the complexity of the interaction, there are usually no strict requirements on how the user marks. Therefore, when the foreground points marked by the user are few, the number of iterations may be large, and the running time of the algorithm Long, affecting the user experience
On the other hand, the GrabCut algorithm in the related art is based on color images for image segmentation. When the color features of the target object to be extracted are not obvious, the segmentation effect of using color images for segmentation is not ideal.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing interactive image segmentation, and terminal
  • Method and device for realizing interactive image segmentation, and terminal
  • Method and device for realizing interactive image segmentation, and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 3

[0289] An embodiment of the present invention also provides a terminal, which includes the above-mentioned device for implementing interactive image segmentation.

application example 1

[0291] The user smears the target object he is interested in on the original image. Using the preprocessing method of this article to preprocess the image, it can include the following steps:

[0292] Step S501: It is detected that the user chooses to mark the target object by smearing;

[0293] For example, the interface provides two buttons for marking, one is "smear" and the other is "outline". If the user clicks the "smear" button, the smear track will be preprocessed.

[0294] Among them, smear and outline are two different ways to mark the target object;

[0295] Generally, smear is to mark the inner area of ​​the target object, and outline is to mark along the outer contour of the target object;

[0296] Step S502: It is detected that the user has smeared on the original image;

[0297] For example, such as Figure 5-a As shown, the user smeared on the original image, and the target object is a "stapler", where the original image is a color image;

[0298] Step S503: Construct a mi...

application example 2

[0352] The user smears the target object he is interested in on the original image, and the image is preprocessed using the preprocessing method of this article, which can accept multiple input (multiple smear), including the following steps:

[0353] Step S601: It is detected that the user chooses to mark the target object by smearing;

[0354] For example, the interface provides two buttons for marking, one is "smear" and the other is "outline". If the user clicks the "smear" button, the smear track will be preprocessed.

[0355] Step S602: It is detected that the user has smeared on the original image;

[0356] For example, such as Figure 6-a-1 As shown, the user made the first smear on the original image, and the target object is the "stapler";

[0357] For example, such as Figure 6-a-2 As shown, the user performed a second smear on the original image, and the target object was "stapler";

[0358] Step S603: Construct a minimum circumscribed rectangle of the smear trajectory, expan...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for realizing interactive image segmentation, and a terminal. The method comprises steps that a geometric figure containing smearing locus is constructed and is expanded to form a mark area, and an area of interest containing the mark area is determined; an input mask artwork of an image segmentation algorithm is generated, pixels of the mark area are taken as foreground points of the mask artwork, and pixels of the area of interest outside the mark area are taken as background points of the mask artwork; a first segmentation parameter of each pixel is determined according to a colorful image and the mask artwork, a second segmentation parameter of each pixel is determined according to a depth image and the mask artwork, and the two types of segmentation parameters are integrated; the segmentation parameter after integration of each pixel is mapped to an undirected image, the undirected image is processed according to a minimal cut-maximal flow algorithm to acquire a mask artwork after fine segmentation, and an image corresponding to the foreground points of the mask artwork after fine segmentation is acquired through segmenting the colorful image. The method is advantaged in that the algorithm operation time is shortened, and the image segmentation effect is improved in combination with the depth information of the image.

Description

Technical field [0001] The present invention relates to the technical field of image processing, in particular to a method, device and terminal for realizing interactive image segmentation. Background technique [0002] Image segmentation refers to dividing a plane image into several unconnected areas according to characteristics such as color, texture, and shape. This is a practical basic technology in the field of image processing. Existing image segmentation techniques include threshold-based segmentation methods, edge-based segmentation methods, region-based segmentation methods, energy functional-based segmentation methods, graph theory-based segmentation methods, and so on. Among them, GraphCut algorithm and its improved version GrabCut algorithm are well-known among graph theory methods. [0003] GraphCut algorithm and its improved version GrabCut algorithm are interactive image segmentation methods based on region annotation. The GraphCut algorithm is an algorithm based o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T7/11G06T7/136G06T7/143G06T7/194
CPCG06T2207/10004G06T2207/20104G06T2207/20221
Inventor 梁舟
Owner NUBIA TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com