Binary neural network model training method, image processing method and device

A binary neural network, neural network technology, applied in the field of artificial intelligence, can solve problems such as the reduction of prediction accuracy

Active Publication Date: 2021-07-30
HUAWEI TECH CO LTD
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, compared with the neural network model, the binary neural network model in the prior art has a much lower prediction accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Binary neural network model training method, image processing method and device
  • Binary neural network model training method, image processing method and device
  • Binary neural network model training method, image processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0084] Embodiments of the present application are described below with reference to the drawings in the embodiments of the present application.

[0085] The embodiments of the present application can be applied to basic processing tasks in computer vision such as image classification, image segmentation, and object detection, such as image detection, album management, video recording, safe city, human-computer interaction, and other scenarios that require image processing.

[0086] It should be understood that the images in the embodiments of the present application may be static images (or called static pictures) or dynamic images (or called dynamic pictures), for example, the images in the present application may be videos or dynamic pictures, or, the present application Images in can also be still images or photographs. For ease of description, the present application collectively refers to static images or dynamic images as images in the following embodiments.

[0087] Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image processing technology in the field of computer vision in the field of artificial intelligence, and discloses a binary neural network model training method and device and an image processing method and device. The training method comprises the following steps: S1, determining a knowledge distillation framework, wherein the teacher network is a trained neural network model, and the student network is an initial binary neural network model M0; S2, training a binary neural network model Mj by using the (j + 1) th batch of images and a target loss function to obtain a binary neural network model Mj + 1, wherein the target loss function comprises an angle loss item, and the angle loss item is used for describing the difference between the included angle between the feature matrix and the weight matrix in the teacher network and the included angle between the feature matrix and the weight matrix in the student network; S3, when a preset condition is met, taking the binary neural network model Mj + 1 as a target binary neural network model; otherwise, enabling j to be equal to j + 1, and repeating the step S2. According to the embodiment of the invention, the prediction precision of the binary neural network model can be improved.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, and in particular to a training method of a binary neural network model, an image processing method and a device. Background technique [0002] Computer vision is an integral part of various intelligent / autonomous systems in various application fields, such as manufacturing, inspection, document analysis, medical diagnosis, it is a science about how to use cameras / video cameras and computers to get what we need, The knowledge of the data and information of the subject. To put it figuratively, it is to install eyes (cameras / video cameras) and brains (algorithms) on computers to replace human eyes to identify, track and measure targets, so that computers can perceive the environment. Because perception can be thought of as extracting information from sensory signals, computer vision can also be thought of as the science of how to make artificial systems "perceive" from im...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/08G06N3/084G06N3/045Y02D10/00
Inventor 刘传建王云鹤韩凯
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products