Sentence processing device, sentence processing method, and recording medium

The text processing device addresses the issue of maintaining accuracy in fine-tuning pre-trained models by masking and replacing proper nouns with predicted words, enhancing performance in tasks like summarization without re-training.

WO2025196954A1 Publication Date: 2025-09-25NEC CORP
2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/010782
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-19
Publication Date
2025-09-25

AI Technical Summary

Technical Problem

Existing techniques for fine-tuning pre-trained models for text summarization fail to maintain accuracy when replacing words without re-training, especially for proper nouns, leading to potential degradation in sentence processing performance.

Method used

A text processing device and method that masks proper nouns, predicts replacement words using a pre-trained model, replaces them with specialized trained models for specific tasks, and restores the original nouns, thereby maintaining accuracy without re-training.

Benefits of technology

Maintains text processing accuracy during fine-tuning by predicting and replacing proper nouns with suitable words, ensuring high performance in tasks like summarization without the need for additional training.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

A sentence processing device according to the present disclosure comprises: a mask means for masking a proper noun included in a text sentence; a prediction means for predicting, by using a pre-trained model for natural language processing of the text sentence, a word to be pseudonymized into a masked portion; a replacement means for replacing the proper noun with the predicted word; an execution means for executing, by using a specialized-type trained model obtained by specializing the pre-trained model for a specific task, natural language processing of the text sentence in which the proper noun has been replaced; a restoration means for restoring, to the original proper noun, the word that has been replaced according to the processing result; and an output means for causing the restored processing result to be outputted.
Need to check novelty before this filing date? Find Prior Art