Are local LLMs good enough now?

  • The new Zephyr 7B model can run locally on an M1 Pro MacBook as fast as ChatGPT is able to stream responses in the browser.