一种基于CNNFeed网络模型的文本分类方法

By combining CNN unit modules and Transformer feedforward neural networks into a single layer, a scalable layered structure is constructed, which solves the problems of low computational efficiency of Transformer and decreased fitting ability of TextCNN, and achieves efficient text classification capabilities.

CN115905539BActive Publication Date: 2026-07-17GANSU WANWEI INFORMATION TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
GANSU WANWEI INFORMATION TECH CO LTD
Filing Date
2022-12-15
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing Transformer models are computationally inefficient and difficult to scale in text classification tasks, while TextCNN models have reduced ability to fit data when the task is complex and cannot efficiently handle large-scale data.

Method used

Design a CNNFeed network model that combines CNN unit modules and Transformer feedforward neural networks into a single layer. Employ same convolution and layer normalization operations to construct a scalable layered structure that can adapt to complex tasks by increasing the number of layers.

Benefits of technology

It improves the computational efficiency and data fitting ability of the model, enabling it to efficiently handle complex text classification tasks and adapt to text classification needs with different amounts and complexities of data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115905539B_ABST
    Figure CN115905539B_ABST
Patent Text Reader

Abstract

本发明涉及自然语言处理技术领域,具体为一种基于CNNFeed网络模型的文本分类方法。应用在办公文件多标签分类任务,本专利采用same卷积CNN模块和前馈神经网络单元作为一个单元,设计成可以根据任务复杂度进行模型可伸缩的结构。而TextCNN本身并非可可伸缩的结构,在任务复杂时,TextCNN拟合数据能力将会下降。相比于Bert、Longformer等Transformer系列模型,因为采用自注意力机制,这要比CNN这种线性操作效率低。同时本专利提出的CNNFeed神经网络引入Transformer中前馈神经网络部分,前馈神经网络部分可以提高本专利拟合大规模数据的能力。
Need to check novelty before this filing date? Find Prior Art