Language model training & evaluation
Start with a baseline and representative business tasks, then use training where the expected improvement justifies the work.
- Instruction dataset construction, cleaning, task balance and held-out evaluation
- SFT supervised fine-tuning and DPO preference alignment
- QLoRA 4-bit quantization, gradient checkpointing and gradient accumulation
- Before/after benchmarks and checks for catastrophic forgetting