Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-modal image segmenting method based on functional mapping

A multi-modal image and functional mapping technology, which is applied in image analysis, image data processing, instruments, etc., can solve problems such as increasing computational overhead, ignoring image complementary information, and establishing associations with difficult image semantic features

Active Publication Date: 2015-07-15
HANGZHOU HUICUI INTELLIGENT TECH CO LTD
View PDF2 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The shortcomings of the above methods are mainly manifested in the following aspects: first, direct processing of the original pixels of the image increases the time complexity of the algorithm and increases the computational overhead; second, the underlying processing techniques such as threshold segmentation and edge segmentation are very difficult It is difficult to establish an association with the semantic features of the image; third, the complementary information between images is ignored, especially there are some common structures and potential information between images containing similar objects, which directly affects the segmentation effect of image objects
Therefore, these methods are not suitable for large-scale image segmentation tasks that contain common targets, and thus have a certain adverse effect on practical applications such as image recognition and target positioning with large orders of magnitude.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal image segmenting method based on functional mapping
  • Multi-modal image segmenting method based on functional mapping
  • Multi-modal image segmenting method based on functional mapping

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Refer to attached figure 1 , to further illustrate the present invention:

[0042] 1. After obtaining the image collection containing the target, perform the following operations:

[0043] 1) Segment each image in the set into superpixel blocks, and use different feature descriptors to characterize the segmented superpixels to obtain a multimodal image representation;

[0044] 2) Establish a superpixel-based graph on the multimodal image, and construct the corresponding Laplacian matrix;

[0045] 3) Characterize the reduced functional space of each image, and establish a functional mapping between image pairs;

[0046] 4) Align the image functional mapping of each modality with the image cues, and introduce an implicit function to maintain the consistency between the functional mappings;

[0047] 5) The functional mapping expression is obtained according to the consistency of the multimodal mapping, and the segmentation function corresponding to the image is calculat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a multi-modal image segmenting method based on functional mapping. For an image set comprising a target, the multi-modal image segmenting method comprises the following steps: (1), segmenting an image into superpixel blocks, and representing the superpixel blocks by using different feature descriptors to obtain a multi-modal image representation; (2), establishing a superpixel map on the multi-modal image, and constructing a corresponding Laplacian matrix; (3), representing a reduction functional space of each image, and establishing functional mapping between image pairs; (4), aligning the image functional mapping of each modal to an image thread, and introducing an implicit function to keep consistency between functional mapping; (5), obtaining a functional mapping representation according to the consistency of the multi-modal mapping, and calculating a segmentation function corresponding to an image through combining and optimizing an objective function to obtain an optimal segmentation representation of the image. According to the multi-modal image segmenting method, each target region block of the image can be accurately judged by using a target potential relevance shared between feature representations of different modals of the image and the image, so that the image segmentation performance and effect are enhanced.

Description

technical field [0001] The invention belongs to the technical field of image segmentation in image processing, in particular to a multimodal image segmentation method based on functional mapping. Background technique [0002] The vigorous development of digital image technology has spawned a large number of emerging industries, such as remote sensing satellite image positioning, medical image analysis, traffic intelligent identification, etc., which has promoted the maturity of the information society. As an important bridge for humans to perceive the world, images are also closely related to the visual field. For example, image processing is in increasing demand and playing an increasingly critical role in various visual applications in the fields of artificial intelligence, machine vision, physiology, medicine, meteorology, military science, etc. As an image preprocessing method, image segmentation has laid a solid foundation for high-level semantic analysis in images. Fo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/00
Inventor 李平李黎李建军俞俊
Owner HANGZHOU HUICUI INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products