What they built
A proof of value on Red Hat OpenShift AI: GPT-4.1 generated synthetic training data, then small models (Phi-4 Mini 3.8B, Qwen 2.5 1.5B/7B) were fine-tuned for multilingual structured extraction from social media, deployable locally.
The result
Fine-tuned Phi-4 Mini JSON validity rose from 1% to ~99% (GPT-4.1: 96%); on a 34-point rubric the best fine-tuned model (Qwen 2.5 7B, 30.8) edged GPT-4.1 with a detailed prompt (30.5); training needed at most 3 GPUs.
The number covers a proof of value; production use and cost are not reported.
The layer: The learning loop
Reviewed corrections are kept as test cases and later used to train models.
- A log of every correction and who reviewed it
- Eval sets that grow from reviewed corrections
- New versions, then post-trained models, from that signal
Read the guide to the learning loop.
Playbooks that use this case