Unlock instant, AI-driven research and patent intelligence for your innovation.

A multi-modal semantic integrity recognition method, device and electronic equipment

A complete, multi-modal technology, applied in speech recognition, speech analysis, electrical digital data processing, etc., can solve problems such as incomplete semantics, and achieve the effect of improving accuracy and improving the effect of voice interaction.

Active Publication Date: 2021-12-14
BEIJING QIYU INFORMATION TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The invention aims to solve the technical problem that the speech robot has incomplete semantics in recognizing the user's intention due to pauses in the user's dialogue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-modal semantic integrity recognition method, device and electronic equipment
  • A multi-modal semantic integrity recognition method, device and electronic equipment
  • A multi-modal semantic integrity recognition method, device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings, and although the exemplary embodiments may be embodied in many specific forms, these should not be construed as limited to the embodiments set forth herein. On the contrary, these exemplary embodiments are provided in order to make the content of the present invention more complete and more convenient to fully convey the inventive concept to those skilled in the art.

[0045] On the premise of complying with the technical concept of the present invention, the structure, performance, effect or other features described in a specific embodiment can be combined in any suitable way into one or more other embodiments.

[0046] During the introduction of specific embodiments, detailed descriptions of structures, performances, effects or other features are intended to enable those skilled in the art to fully understand the embodiments. However, it does no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-modal semantic integrity recognition method, device and electronic equipment. The method includes: creating a multi-modal semantic integrity model, and inputting text data, audio data and dialogue data of the current user into the In the multimodal semantic integrity model, the semantic integrity identification result is obtained; and the user semantics of the current dialogue is adjusted according to the semantic integrity identification result. Wherein, the multimodal semantic integrity model includes a first model for extracting audio vector features and text vector features in audio data and text data respectively, and a second model for combining audio vector features, text vector features and dialog Feature recognition for semantic integrity. The present invention can recognize the completeness of semantics according to the three modes of text data, audio data and dialogue data, thereby effectively improving the accuracy of model intention recognition and improving the effect of voice interaction between the voice robot and the user.

Description

technical field [0001] The present invention relates to the technical field of speech intelligence, in particular, to a method, device, electronic equipment and computer-readable medium for multi-modal semantic integrity recognition. Background technique [0002] With the development of artificial intelligence technology, the application of voice robots is becoming more and more extensive. Based on technologies such as speech recognition, speech synthesis, and natural language understanding, voice robots can provide enterprises with an intelligent human-computer interaction experience of "listening, speaking, and understanding" in various practical application scenarios. At present, voice robots have been widely used in telemarketing, intelligent Q&A, intelligent quality inspection, real-time speech subtitles, interview recording and other scenarios. [0003] The voice robot first performs natural speech understanding of the user's voice to identify the user's intention, an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/35G10L15/18G10L15/183G10L15/26G10L25/78
CPCG06F40/35G10L25/78G10L15/1815G10L15/183
Inventor 张常睿李蒙
Owner BEIJING QIYU INFORMATION TECH CO LTD