Training private and efficient language models with synthetic data from llms

Recommended citation: Da Yu, Arturs Backurs, Sivakanth Gopi, Huseyin Inan, Janardhan Kulkarni, Zinan Lin, Chulin Xie, Huishuai Zhang, Wanrong Zhang, "Training private and efficient language models with synthetic data from llms." Socially Responsible Language Modelling Research, 2023.
Download Paper