Find Before You Fine-Tune: A Diagnostic Study of Small LLMs for Cybersecurity QA
Introduction of FiT (Find before Fine-Tune), a diagnostic framework evaluating small LLMs on vocabulary recognition, parametric knowledge, and contextualization of retrieved information. Empirical study of five 7B-parameter models reveals that fine-tuning often degrades vocabulary and parametric knowledge rather than uniformly improving performance. Knowledge-focused tuning causes moderate, rank-preserving degradation, while instruction-focused tuning induces abstention that collapses measured k
Analysis
TL;DR
- Introduction of FiT (Find before Fine-Tune), a diagnostic framework evaluating small LLMs on vocabulary recognition, parametric knowledge, and contextualization of retrieved information.
- Empirical study of five 7B-parameter models reveals that fine-tuning often degrades vocabulary and parametric knowledge rather than uniformly improving performance.
- Knowledge-focused tuning causes moderate, rank-preserving degradation, while instruction-focused tuning induces abstention that collapses measured knowledge and inverts rankings.
- Pre-fine-tuning FiT scores effectively predict the direction of post-tuning changes, allowing for better model selection prior to adaptation.
- The study advocates for task-oriented diagnosis to screen out unsuitable models, avoid unnecessary fine-tuning costs, and ensure safer deployment in cybersecurity QA.
Why It Matters
This research challenges the common assumption that fine-tuning always improves model performance for specific domains, highlighting significant risks such as knowledge erosion and increased hallucination in small models. For AI practitioners working in high-stakes fields like cybersecurity, understanding these trade-offs is crucial for selecting the right base model and fine-tuning strategy to maintain reliability and accuracy.
Technical Details
- FiT Framework: A diagnostic tool characterizing models across three dimensions: vocabulary recognition, parametric knowledge retention, and ability to contextualize retrieved information.
- Experimental Setup: Evaluated five open-weight 7-billion-parameter models under two distinct fine-tuning regimes: knowledge-focused and instruction-focused.
- Key Findings: Instruction-focused tuning led to "induced abstention," where models refused to answer, causing a collapse in measured knowledge metrics and inverting performance rankings compared to knowledge-focused tuning.
- Predictive Analysis: Used rank-correlation analysis to demonstrate that pre-fine-tuning FiT scores correlate with post-tuning outcomes, enabling proactive model screening.
Industry Insight
- Adopt pre-deployment diagnostic frameworks like FiT to assess model suitability for critical domains before investing in expensive fine-tuning processes.
- Be cautious with instruction-focused fine-tuning for small models in knowledge-intensive tasks, as it may lead to excessive abstention and loss of factual recall.
- Prioritize models with strong baseline parametric knowledge and vocabulary recognition to mitigate the risk of catastrophic forgetting during domain adaptation.
Disclaimer: The above content is generated by AI and is for reference only.