一种基于双层联合约束优化的GIS大语言模型持续学习方法

By employing a two-layer joint constraint optimization strategy, the problems of knowledge fusion and forgetting in the continuous learning of the GIS large language model were solved, realizing multi-stage continuous fusion and stable representation of GIS professional knowledge, and improving the model's adaptability and stability.

CN122198038BActive Publication Date: 2026-07-17CHINA UNIV OF MINING & TECH

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
CHINA UNIV OF MINING & TECH
Filing Date
2026-05-15
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing technologies struggle to enable continuous learning of large language models in the GIS field, particularly in maintaining existing knowledge while avoiding catastrophic forgetting, and in effectively integrating multi-stage GIS knowledge.

Method used

A two-layer joint constraint optimization strategy is adopted. The pre-trained model is aligned and trained using the low-rank adaptive LoRA algorithm. Instantaneous gradient direction constraints and global parameter drift constraints are constructed to enable the model to continuously integrate and stably retain multi-stage GIS professional knowledge in a unified parameter space.

Benefits of technology

It enhances the model's continuous learning ability, adapts to the dynamic evolution of application needs in the GIS field, ensures rapid absorption of new knowledge and complete retention of historical knowledge, and improves the model's stability and adaptability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122198038B_ABST
    Figure CN122198038B_ABST
Patent Text Reader

Abstract

本发明公开一种基于双层联合约束优化的GIS大语言模型持续学习方法,涉及地理信息科学与深度学习技术领域,通过采用低秩适应LoRA算法冻结预训练模型原始参数,在统一LoRA参数空间完成模型与第一阶段GIS专业知识的对齐;构建瞬时梯度方向约束与全局参数漂移约束相结合的双层联合优化策略,通过梯度分量剔除与参数偏移限制,实现第二阶段知识学习与历史知识留存;针对后续持续涌现的GIS知识迭代执行该优化策略,最终得到具备持续学习能力的GIS专用大语言模型。本发明可在统一参数空间完成多阶段GIS知识的持续融合,提升模型持续学习稳定性与跨阶段知识处理能力,适配GIS领域知识、数据与场景的动态演化需求。
Need to check novelty before this filing date? Find Prior Art