
TatuEngine
Aug 12, 2026
TatuEngine: the codec that made the model fit — and the lm_head that wouldn't cooperate
BitMamba-2 1B's in-engine inference representation was unworkable in memory. A compact ternary block codec delivered orders of magnitude of savings, with the lm_head diverging mid-validation.
Continue reading →