Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Were you using mlx-lm? I've had good performance with that on Macs. (Sadly, the lead developer just left Apple.)

Admittedly, I haven't tried these models on my Mac, but I have on my DGX Spark, and they ran fine. I didn't see the slowdown you're mentioning.

 help



(I think) yes, via the latest openwebui + ollama.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: