Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Material identification method and device based on laser speckle and modal fusion

A laser speckle and modal technology, applied in character and pattern recognition, methods for obtaining spatial resolution, optics, etc., to achieve the effect of improving the ability of the system to identify materials

Active Publication Date: 2020-03-31
TSINGHUA UNIV
View PDF6 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The material recognition task is still a challenging problem by exploiting the interaction of laser speckle and material and its modal fusion with visible light vision

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Material identification method and device based on laser speckle and modal fusion
  • Material identification method and device based on laser speckle and modal fusion
  • Material identification method and device based on laser speckle and modal fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary and are intended to explain the present invention and should not be construed as limiting the present invention.

[0035] The material identification method and device based on laser speckle and mode fusion proposed according to the embodiments of the present invention will be described below with reference to the accompanying drawings. First, the material recognition method and device based on laser speckle and mode fusion proposed according to the embodiments of the present invention will be described with reference to the accompanying drawings recognition methods.

[0036] figure 1It is a flowchart of a material recognition method based o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a material identification method and device based on laser speckle and modal fusion, and the method comprises the following steps: carrying out the data collection of a measured object through a structured light camera of a projection laser speckle structure, and obtaining a color modal image, a depth modal image and an infrared modal image; preprocessing the color modal image, the depth modal image and the infrared modal image; inputting the preprocessed color modal image, depth modal image and infrared modal image into a preset depth neural network; training an acquired data set, learning material-level features from corresponding speckle structures and color and depth modal coupling relationships, and generating an object material classification model for material classification, so as to generate a material prediction result through the object material classification model in a test stage. According to the method, material identification can be realized by utilizing interaction of laser speckles and materials and modal fusion of the laser speckles and visible light vision, and the method is simple and easy to realize.

Description

technical field [0001] The invention relates to the technical fields of optical laser speckle imaging, computer vision, deep learning and material identification, and in particular to a material identification method and device based on laser speckle and mode fusion. Background technique [0002] A variety of materials constitute a wide variety of objects in life. Common materials include wood, plastic, paper, rubber, fiber, and more. In the environmental protection industry, "garbage is a misplaced resource." Reasonable material identification can realize the effective use of resources; in industrial production, material identification can realize abnormal detection and detect production problems in advance; in academia, material identification can help robots more Good understanding of the surrounding environment. Based on the needs of the above fields, the research on object material recognition is very necessary. [0003] The existing main research method is to use the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/20G06K9/62G06N3/04G06T7/50G06T7/90G06V10/143G06V10/56G06V10/60G06V10/764G06V10/774
CPCG06T7/90G06T7/50G06V10/143G06N3/045G06F18/22G06F18/25G06F18/214G02B27/48G01N21/31G01N2021/178G01N2201/1296G01N2201/06113G06V10/60G06V10/56G06V2201/06G06V10/82G06V10/803G06V10/764G06V10/774G06F18/251Y02P90/30G01N21/39G06T7/0004G06T2207/10024G06T2207/10028G06T2207/10048G06T2207/20081G06T2207/20084G06T5/92
Inventor 方璐季梦奇毛适戴琼海
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products