K2 Horizon 36B-A4B for local AI: what the 4B-active model actually needs
K2 Horizon 36B-A4B packs 36B parameters while activating only 4B per token. That sounds perfect for local AI. The catch is what it takes to run well on real hardware.
K2 Horizon 36B-A4B packs 36B parameters while activating only 4B per token. That sounds perfect for local AI. The catch is what it takes to run well on real hardware.