..or was there an LLM training logbook of sorts shared by Google Brain researchers which detailed all the experiments they did, and the approaches...
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/machinelearning by /u/demonic_mnemonic on 2024-10-16 10:45:49+00:00.

…or was there an LLM training logbook of sorts shared by Google Brain researchers which detailed all the experiments they did, and the approaches they tried while training an LLM?

I distinctly remember seeing such a project up on GitHub but it’s nowhere to be seen now !

It was meant as a sort of guide for anyone setting out to train an LLM to avoid common pitfalls and such. It might not have been google specifically though.

Am I dreaming ?

(Edit: more context)