Deep space rock image segmentation and identification method based on spiking neural network

A spiking neural network and image segmentation technology, applied in neural learning methods, biological neural network models, neural architectures, etc., to achieve the effects of strong generality and scalability, low latency, and reduced computing latency

Pending Publication Date: 2021-08-27
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the field of image segmentation, convolutional neural networks are currently widely used for image segmentation, and relatively mature network structures and training algorithms have been formed, such as FCN, U-net, FPN, etc., but in the space environment, how to improve deep space detectors? Adapting to the small sample problem and resource shortage problem has become a big challenge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep space rock image segmentation and identification method based on spiking neural network
  • Deep space rock image segmentation and identification method based on spiking neural network
  • Deep space rock image segmentation and identification method based on spiking neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] like figure 1 As shown, a rock image segmentation and recognition method based on spiking neural network, including the following steps:

[0053] S1. Preprocessing rock images in deep space environment;

[0054] S11. Using the Artificial LunarLandscape dataset image created by the Ishigami Laboratory (Space Robotics Group) of Keio University in Japan, the dataset contains 9766 synthetic images of lunar landscapes and their corresponding category segmentation (sky, ground, large-size rocks, small size rocks), while containing the bounding box for large size rocks;

[0055] S12. Preprocessing the data set. Assign the results of the model to colors to prepare for later model predictions, first use argmax to convert to category values ​​[0,1,2,3], and then convert category values ​​to RGB three channel values ​​​​[255,0,0 ], [0,0,0], [0,0,255], [0,255,0]. The representative colors of the sky, ground, large-size rocks, and small-size rocks are red, black, blue, and green...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep space rock image segmentation and identification method based on a spiking neural network. The method comprises the following steps of constructing an image segmentation model based on a convolutional neural network (CNN), conducting semantic segmentation on the preprocessed rock image in the deep space environment, and segmenting the image into the sky, the ground, the large-size rock and the small-size rock, converting the CNN-based segmentation model into a spiking neural network (SNN)-based segmentation model, performing rock image segmentation by using an SNN-based segmentation model, and identifying the large-size rock by using the SNN-based image identification model converted in the mode. According to the method, the advantages of the traditional CNN in the aspects of feature extraction and precision in image segmentation and recognition are reserved, and meanwhile, the advantages of the SNN in the aspects of low power consumption, low time delay and the like can be exerted. The segmentation of the deep space rock image and the identification work of the large-size rock are completed through the network which better meets the real-time requirement, and a foundation is laid for the subsequent navigation and obstacle avoidance of the deep space detector.

Description

technical field [0001] The invention belongs to the technical field of vision-based image segmentation and image recognition after a deep-space probe lands, and in particular relates to a deep-space rock image segmentation and recognition method based on a pulse neural network. Background technique [0002] Since the 21st century, with the development of computer science and space technology, deep space exploration technology has become the only means for human beings to protect the earth, enter the universe, and find a new living home, which has attracted great attention from all countries in the world. Deep space exploration refers to the exploration of the moon and celestial bodies or space beyond the moon, and is an important part of human space activities. At present, soft landing on the surface of stars, conducting on-site patrol sampling, and sending the obtained samples back to the earth for research have also become the focus of deep space exploration in various cou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/34G06K9/32G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/25G06V10/267G06N3/045G06F18/214
Inventor 袁家斌马玮琦查可可
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products