Arm & ExecuTorch 0.7: Bringing Generative AI to the masses

Arm's KleidiAI powers ExecuTorch 0.7, enabling automatic on-device acceleration for GenAI across many Arm CPUs and edge devices. Using SDOT and I8MM, models like Llama 3.2 run efficiently on most Android devices and Raspberry Pi 5, with notable gains in prefill/decode speed.

Source

HuggingFace Blog

Ingéré

13 AOÛT 2025 · 19:10

Score édito

4.0 / 5