InstructLab LLM guide

Large Language Model (LLM)	Format	Description	Serving Support	Purpose	Access	Hugging face link
Granite-7b-lab	Safetensor	Lab fine-tuned Granite model	Linux with GPU	Default student model	Manual download	granite-7b-lab
Granite-7b-lab-GGUF	GGUF	Quantized version of the granite-7b-lab model	Mac or Linux	Default chat model	Downloads with default ilab model download command	granite-7b-lab-GGUF
Merlinite-7b-lab-GGUF	GGUF	Quantized version of the Merlinite-7b-lab model	Mac or Linux	Teacher model with SDG simple pipeline	Downloads with default ilab model download command	merlinite-7b-lab-GGUF
Mistral-7B-Instruct-v0.2-GGUF	GGUF	Quantized version of the Mistral-7B-Instruct-v0.2 model	Mac or Linux	Teacher model for SDG full pipeline	Downloads with default ilab model download command	Mistral-7B-Instruct-v0.2-GGUF
Prometheus-8x7b-v2.0	Safetensor	Evaluation model	Linux with GPU	Judge model	Manual download	prometheus-8x7b-v2.0
Merlinite-7b-lab	Safetensor	LAB fine-tuned Merlinite-7b model	Linux with GPU	Student model	Manual download	merlinite-7b-lab

For reference to terms, see The InstructLab glossary.