RoLAとReLoLA

RoLA

fine-tuningを高速化するやつ

ReLoLA

事前学習を高速化するやつらしい

[2307.05695] Stack More Layers Differently: High-Rank Training Through Low-Rank Updates