Hazar Yueksel, Ramon Bertran, et al.
MLSys 2020
With rising interests of using frozen pre-trained models for diverse downstream applications, how to design a performance-effective and parameter-efficient training framework is one open topic. When some recently discovered techniques share similar design principles, we aim to provide an in-depth summary and draw a taxonomy on the differences of parameter-efficient learning modules. The presenting topic is emerging as an essential pathway to design foundation models for the research community.
Hazar Yueksel, Ramon Bertran, et al.
MLSys 2020
Saiteja Utpala, Alex Gu, et al.
NAACL 2024
Natalia Martinez Gil, Dhaval Patel, et al.
UAI 2024
Jhih-Cing Huang, Yu-Lin Tsai, et al.
ICASSP 2023