Language model fusion method and device, medium and computer program product

A fusion method and language model technology, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as poor fusion effect of language models, and achieve the effect of improving accuracy

Pending Publication Date: 2021-07-20
WEBANK (CHINA)
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of this application is to provide a language model fusion method, device, medium and comp

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Language model fusion method and device, medium and computer program product
  • Language model fusion method and device, medium and computer program product
  • Language model fusion method and device, medium and computer program product

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.

[0039] The embodiment of the present application provides a language model fusion method. In the first embodiment of the language model fusion method of the present application, refer to figure 1 , the language model fusion method is applied to a language model fusion device, and the language model fusion method includes:

[0040] Step S10, acquiring the speech data of the target language scene, and extracting the speech-to-text scoring data for converting the speech data into text data and the word error rate data corresponding to the text data;

[0041]In this embodiment, it should be noted that the target language scene is a language scene that requires speech recognition based on a fusion language model, for example, a meeting scene, a news scene, a chat scene, etc., and the text data includes at least one tex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a language model fusion method and device, a medium and a computer program product, and the method comprises the steps: obtaining voice data of a target language scene, and extracting voice-to-text scoring data for converting the voice data into text data, and word error rate data corresponding to the text data; acquiring confusion score data of a to-be-fused language model corresponding to each preset language scene on the text data, and combining each confusion score data, the voice-to-text score data and the word error rate data to obtain combined training data; based on the combined training data, constructing a classification sorting model; and based on the model weight parameters of the classification sorting model, performing weighted fusion on the to-be-fused language models to obtain a fused language model. The technical problem that the language model fusion effect is poor is solved.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence in financial technology (Fintech), and in particular to a language model fusion method, device, medium and computer program product. Background technique [0002] With the continuous development of financial technology, especially Internet technology finance, more and more technologies (such as distributed, artificial intelligence, etc.) The industry also has higher requirements for the distribution of to-do items. [0003] With the continuous development of computer technology, the application of artificial intelligence is becoming more and more extensive. At present, when performing speech recognition in a new language scene, due to the lack of data in the new language scene, the data of each language scene is usually The language model is fused to obtain a fusion language model adapted to the new language scene. At present, based on the corpus correlation correspondin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/26G10L15/18G10L15/01
CPCG10L15/01G10L15/18G10L15/26
Inventor 黄小玲宋元峰姜迪徐倩
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products