Financial risk prediction method and device based on text pre-training and multi-task learning

Abstract

The invention relates to a financial risk prediction method and device based on text pre-training and multi-task learning. The method comprises the steps of obtaining a to-be-processed text; inputting the to-be-processed text into a first neural network model to determine whether the content of the to-be-processed text includes financial risks according to the processing flow of the risk identification task; under the condition that the content of the to-be-processed text comprises the financial risk, determining the risk type of the financial risk according to the processing flow of the risk classification task by utilizing a first neural network model; and determining a risk subject matched with the risk type by using the first neural network model according to a processing flow of the risk subject identification task. According to the method and the device, the problem of poor model performance caused by lack of deep semantic mining is solved through a pre-training language model technology, and the technical problems of limited data volume and poor model performance caused by incapability of information sharing among tasks are solved by adopting multi-task processing.

Description

technical field [0001] The present application relates to the technical field of risk prediction, in particular to a financial risk prediction method and device based on text pre-training and multi-task learning. Background technique [0002] With the in-depth application of the Internet in financial services, Internet finance has gradually entered the public eye. Internet finance refers to the behavior of financial intermediation, payment and related information services through or relying on Internet technology and tools. It uses the Internet platform to provide Finance provides new ways of obtaining information, diversified risk management tools and risk diversification tools. [0003] The current Internet + financial structure is composed of traditional financial institutions and non-financial institutions. Traditional financial institutions mainly refer to Internet innovation of traditional financial business, e-commerce innovation, APP software, etc.; non-financial in...

AI Technical Summary

Problems solved by technology

[0010] This application provides a financial risk prediction method and device based on text pre-training and multi-task learning to solve the above-mentioned "feature construction is relatively simple, the obtained word vector is relatively sparse, and the lack of deep mining of semantics leads to poor model performance. The limited amount of data and the inability to share information between tasks lead to poor model performance” technical problem

Images