高级检索

基于动态记忆与渐进冷冻分类器的持续关系抽取

Dynamic Memory and Progressive Freezing Classifier for Continual Relation Extraction

  • 摘要: 针对持续关系抽取中的灾难性遗忘问题,尤其是在记忆分配不足与分类器参数漂移方面所面临的挑战,提出一种基于动态记忆与渐进冷冻分类器的模型(DMPFC)。该模型通过动态调整记忆分配并逐步冷冻各任务对应的分类器参数,有效增强对历史知识的长期保持能力。在方法设计上,模型主要包括新关系学习与记忆回放2个阶段:在学习阶段,采用数据增强策略并配合渐进冷冻分类器机制,为每个新任务分配独立的分类器,以实现表征隔离;同时,依据关系语义的重要性动态分配记忆空间,通过层次聚类筛选代表性样本,并利用滑动平均策略更新关系原型。在回放阶段,结合双视图对比学习与分层知识蒸馏,以增强表征一致性与知识保留能力;此外,引入混合原型相似度度量,以提升推理过程的鲁棒性,从而协同优化特征表示和知识保持。实验结果表明:DMPFC在FewRel和TACRED数据集的最终任务上准确率分别达到87.5%和81.3%,显著优于现有主流方法,验证了其在复杂语境中持续进行关系识别与更新的有效性。本研究为在动态演化、大规模知识图谱场景中构建实用化的持续学习系统提供了可行的技术路径与算法基础。

     

    Abstract: A model based on dynamic memory and progressively frozen classifiers (DMPFC) was proposed to address the catastrophic forgetting issue in continual relation extraction, particularly the challenges of insufficient memory allocation and classifier parameter drift. By dynamically adjusting memory allocation and gradually freezing the classifier parameters corresponding to each task, the model's ability to retain historical knowledge over the long term was effectively enhanced. In terms of methodology design, the model mainly included two stages: new relation learning and memory replay. During the learning stage, a data augmentation strategy was adopted along with a progressively frozen classifier mechanism, where an independent classifier was allocated for each new task to achieve representation isolation. Meanwhile, memory space was dynamically allocated based on the semantic importance of relations, representative samples were selected through hierarchical clustering, and relation prototypes were updated using a moving average strategy. In the replay stage, dual-view contrastive learning and hierarchical knowledge distillation were combined to enhance representational consistency and knowledge retention capabilities. Additionally, a hybrid prototype similarity metric was introduced to improve the robustness of the inference process, thereby jointly optimizing feature representation and knowledge preservation. Experimental results demonstrate that the DMPFC achieves accuracies of 87.5% and 81.3% on the final tasks of the FewRel and TACRED datasets, respectively, significantly surpassing existing mainstream methods, which proves its effectiveness in the continuous recognition and updating of relations within complex contexts. This study provides a feasible technical pathway and an algorithmic foundation for constructing practical continual learning systems in scenarios involving dynamically evolving and large-scale knowledge graphs.

     

/

返回文章
返回