Yep, it depends on what your goal is.

This doesn't say that LLaMA didn't go far enough.

Not exactly, but it did say they could have gone further than they did without wasting time and energy on infinitesimally small gains though