Multi-modal semantic integrity recognition method and device and electronic equipment

A recognition method and integrity technology, applied in speech recognition, speech analysis, electrical digital data processing, etc., can solve problems such as incomplete semantics, achieve the effect of improving accuracy and enhancing the effect of voice interaction

Active Publication Date: 2020-12-18
北京淇瑀信息科技有限公司
View PDF9 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention aims to solve the technical problem that the speech robot has incomplete semantics in recognizing the user's intention due to pauses in the user's dialogue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal semantic integrity recognition method and device and electronic equipment
  • Multi-modal semantic integrity recognition method and device and electronic equipment
  • Multi-modal semantic integrity recognition method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings, and although the exemplary embodiments may be embodied in many specific forms, these should not be construed as limited to the embodiments set forth herein. On the contrary, these exemplary embodiments are provided in order to make the content of the present invention more complete and more convenient to fully convey the inventive concept to those skilled in the art.

[0045] On the premise of complying with the technical concept of the present invention, the structure, performance, effect or other features described in a specific embodiment can be combined in any suitable way into one or more other embodiments.

[0046] During the introduction of specific embodiments, detailed descriptions of structures, performances, effects or other features are intended to enable those skilled in the art to fully understand the embodiments. However, it does no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-modal semantic integrity recognition method and device and electronic equipment, and the method comprises the steps: building a multi-modal semantic integrity model, respectively inputting the text data, audio data and dialogue data of a current user into the multi-modal semantic integrity model, and obtaining a semantic integrity recognition result; and adjusting the user semantics of the current dialogue according to the semantic integrity identification result. The multi-modal semantic integrity model comprises a first model used for respectively extracting audio vector features and text vector features in the audio data and the text data, and a second model used for identifying semantic integrity in combination with the audio vector features, the text vector features and the dialogue features. The integrity of semantics can be recognized according to three modes of the text data, the audio data and the dialogue data, so that the accuracy of model intention recognition is effectively improved, and the voice interaction effect of the voice robot and a user is improved.

Description

technical field [0001] The present invention relates to the technical field of speech intelligence, in particular, to a method, device, electronic equipment and computer-readable medium for multi-modal semantic integrity recognition. Background technique [0002] With the development of artificial intelligence technology, the application of voice robots is becoming more and more extensive. Based on technologies such as speech recognition, speech synthesis, and natural language understanding, voice robots can provide enterprises with an intelligent human-computer interaction experience of "listening, speaking, and understanding" in various practical application scenarios. At present, voice robots have been widely used in telemarketing, intelligent Q&A, intelligent quality inspection, real-time speech subtitles, interview recording and other scenarios. [0003] The voice robot first performs natural speech understanding of the user's voice to identify the user's intention, an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/35G10L15/18G10L15/183G10L15/26G10L25/78
CPCG06F40/35G10L25/78G10L15/1815G10L15/183
Inventor 张常睿李蒙
Owner 北京淇瑀信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap