Ollama adopts MLX for faster AI performance on Apple silicon Macs
One of the best tools to run AI models locally on a Mac just got even better. Here’s why, and how to run it.
Expand Expanding Close
Apple shows how much faster the M5 runs local LLMs compared to the M4
A new post on Apple’s Machine Learning Research blog shows how much the M5 Apple silicon improved over the M4 when it comes to running a local LLM. Here are the details.
Expand Expanding CloseApple’s machine learning framework is getting support for NVIDIA’s CUDA platform
Apple’s MLX machine learning framework, originally designed for Apple Silicon, is getting a CUDA backend, which is a pretty big deal. Here’s why.
Expand Expanding Close