Deep learning-based intelligent industrial robot speech interaction and control method

An industrial robot, voice interaction technology, applied in speech analysis, speech recognition, instruments, etc., can solve the problems of long decoding time, difficult to widely use, high system training complexity, and achieve the effect of improving labor productivity and reducing labor intensity.

Inactive Publication Date: 2017-06-27
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In recent years, with the upsurge of deep learning rising again, the research on the speech recognition system based on deep neural network has been hot. At present, the best speech recognition system uses a bidirectional long short-term memory ne

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning-based intelligent industrial robot speech interaction and control method
  • Deep learning-based intelligent industrial robot speech interaction and control method
  • Deep learning-based intelligent industrial robot speech interaction and control method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with specific examples.

[0028] Such as figure 1 As shown, the deep learning-based intelligent industrial robot voice interaction and control method described in this embodiment includes the following steps:

[0029] 1) Speech is converted into a spectrogram, and the original speech is converted into an image that can be used as an input by the short-time Fourier transform FFT method, specifically: using the short-time Fourier transform FFT method for each One frame is processed, and the spectrogram composed of time domain and frequency domain is obtained through time extraction algorithm and frequency extraction algorithm. In the process of frequency extraction, unnecessary frequencies are compressed to reduce the impact of noise .

[0030] 2) To model the entire sentence speech, input the spectrogram obtained in step 1) as a feature map into a neural network composed of multiple convolutional laye...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning-based intelligent industrial robot speech interaction and control method. The method comprises the following steps that: 1) speech is converted into a speech spectrum: original speech is converted into an image through FFT (Fast Fourier Transformation), wherein the image can be used as input; 2) modeling is performed on the whole speech sentence: the speech spectrum, adopted as input, is utilized to perform unsupervised training on a convolutional neural network; 3) the output sequence O of the convolutional neural network is compared with a tag T, and the convolutional neural network is adjusted in a supervised manner through the BP algorithm; and 4) specific text information is inputted into a robot as a control command. According to the deep learning-based intelligent industrial robot speech interaction and control method of the invention, the speech recognition technology and the industrial robot are combined together, and therefore, a traditional production mode is changed, the labor intensity of workers is decreased, labor productivity is enhanced, and the intelligentization development of industrial technologies can be promoted.

Description

technical field [0001] The invention relates to the technical field of deep learning and voice control of industrial robots, in particular to a voice interaction and control method for intelligent industrial robots based on deep learning. Background technique [0002] For a long time, speech, as a unique human ability, is the most essential difference between humans and other animals, and it is also the most important tool and channel for humans to communicate and obtain external information resources. The 21st century is an era of vigorous development of information technology. Speech recognition technology, as an important component of the human-computer interaction branch in this torrent, is an important interface for human-computer interaction, making the interaction between humans and machines more automated and intelligent, and realizing the machine. The main way to understand human language has promoted the development of artificial intelligence. Therefore, the combi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/22G10L21/02G10L21/0216
CPCG10L15/22G10L21/02G10L21/0216
Inventor 李莹莹肖南峰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap