Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Model training method and device

A model training and language model technology, applied in the field of machine learning, can solve the problems of high labor cost, large amount of corpus data, consumption, etc., and achieve the effect of saving the cost of manual labeling

Inactive Publication Date: 2021-09-03
BEIJING SANKUAI ONLINE TECH CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, knowledge mining through machine learning models requires a large amount of manually labeled corpus data during model training, which requires high labor costs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method and device
  • Model training method and device
  • Model training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the purpose, technical solution and advantages of this specification clearer, the technical solution of this application will be clearly and completely described below in conjunction with specific embodiments of this specification and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the description, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present application.

[0055] This specification provides a model training method for training a language model to perform knowledge mining through the language model, and construct knowledge bases in different fields based on the mined entities. The technical solutions provided by various embodiments of the present application will be described in detail below in conjunction with the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a model training method and device, which can be used for determining a training sample containing any entity from each segment of text related to a target field based on each entity in a constructed knowledge base, and carrying out sequence labeling on each training sample according to the position of the entity in each training sample and the entity attribute of the entity. Then, the pre-trained language model is further trained through each training sample and the label thereof. According to the method, the training samples are determined on the basis of the entities in the constructed knowledge base, and the training samples are automatically labeled, so that the manual labeling cost is saved.

Description

technical field [0001] The present application relates to the technical field of machine learning, and in particular to a model training method and device. Background technique [0002] Knowledge graph is a graph data structure composed of nodes and edges, which is mainly used in the fields of intelligent question answering and information recommendation. Among them, each node in the knowledge graph represents an entity, and each edge represents the relationship between entities. [0003] At present, when constructing knowledge graphs in various fields, it is first necessary to obtain encyclopedia data in related fields, and perform knowledge mining on the obtained encyclopedia data to obtain relevant entity content and the relationship between entities. Finally, according to each entity and the relationship between them, the knowledge graph of the related field is constructed. [0004] Among them, a common knowledge mining method is based on machine learning or deep learn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06F16/35G06F16/36G06F40/247G06F40/295G06F16/23G06F16/2458
CPCG06F16/35G06F16/367G06F40/247G06F40/295G06F16/23G06F16/2465G06F18/214
Inventor 彦虹羽郑刚沈亮陈骐
Owner BEIJING SANKUAI ONLINE TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products