CosmicFish-HRM
Adaptive Reasoning via Hierarchical Recurrent Mechanisms in Compact Language Models
Large language models achieve strong reasoning, though often at the cost of massive parameter counts and expensive inference. We explore a different direction: adaptive reasoning depth in compact language models.
CosmicFish-HRM is built around a Hierarchical Reasoning Module that dynamically allocates reasoning compute during inference. Instead of applying fixed computation to every input, the model iterates through high-level and low-level reasoning cycles and learns when to halt based on input complexity.