reasoning

2 posts

Sep 09, 2026

The Ten Seconds of Silence — when the model thinks and returns nothing

An LLM call ends in 200 OK with empty content and the pipeline moves on like nothing happened. Diagnosis: reasoning models burn the token budget thinking and nothing is left for the answer. The fixes: a token ceiling with real margin, and a parser that tolerates a data: [DONE] glued to the JSON.

Operation Convergence — when TatuEngine decided to teach itself

After learning to infer (252× GPU speedup), TatuEngine went for the Master-Apprentice cycle: a Qwen2.5-3B teacher with LoRA distilling structured reasoning ([THOUGHT]/[ANSWER]) into the BitMamba-2 1B student. Six versions in one day (v0.17→v0.22.2), 381 examples, and the convergence that wouldn't come until the system message fix.

Continue reading →

tatuengine convergence teacher-student

Browse by tags

The Ten Seconds of Silence — when the model thinks and returns nothing

Operation Convergence — when TatuEngine decided to teach itself