K2 Horizon 36B-A4B for local AI: what the 4B-active model actually needs

 

K2 Horizon 36B-A4B packs 36B parameters while activating only 4B per token. That sounds perfect for local AI. The catch is what it takes to run well on real hardware. #AI https://www.popularai.org/p/k2-horizon-36b-a4b-local-ai