<p>A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.</p><h3>Features</h3><ul><li>3 interface modes: default (two columns), notebook, and chat.<li>Multiple model backends: Transformers, llama.cpp (through llama-cpp-python), ExLlamaV2, AutoGPTQ, AutoAWQ, GPTQ-for-LLaMa, CTransformers, QuIP#.</li><li>Dropdown menu for quickly switching between different models.</li><li>