The risk of catastrophic forgetting brought about by adaptive large models

SEAL adaptive language model sparked heated discussions and was interpreted as "GPT-6 may have life in the sense of computing"

Researchers from MIT and other institutions published a paper "Self-Adapting Language Models" in arXiv, proposing the adaptive language model framewor...