Ask HN: PyTorch or Jax for Making an LLM?

by gorenb on 8/8/2023, 10:09 PM with 3 comments
  • by brucethemoose2 on 8/8/2023, 10:14 PM

    You mean for finetuning an LLM?

    PyTorch + QLORA is very affordable.

    Otherwise JAX on TPUs is a reasonable way to finetune on a large dataset. I'm not sure about the exact cost these days.