<p>OpenChat: Advancing Open-source Language Models with Imperfect Data</p><ul><li>OpenChat is an innovative library of open-source language models, fine-tuned with C-RLFT - a strategy inspired by offline reinforcement learning.</li><li>Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, even with a 7B model which can be run on a consumer GPU (e.g. RTX 3090).</li><li>Despite our