Yes but also no. Bit flips will happen unless you have rad-hardened computers but apparently, bit-flips are not really too problematic for LLM training. I guess when correct answers are optional, correct buts are as well.
Not trying to be an asshole, just giving info: the radiation shielding on earth is achieved (mostly?) by the magnetic field that diverts the big particle cannon ammunition.
Naive question, but would bit-flip also be a problem without the atmosphere to shield (some) radiation?
Yes but also no. Bit flips will happen unless you have rad-hardened computers but apparently, bit-flips are not really too problematic for LLM training. I guess when correct answers are optional, correct buts are as well.
I can’t tell if “correct buts” is just a genius detail in this comment… Or a genius happy little bitflip accident.
talks about this, in conclusion yes
Not trying to be an asshole, just giving info: the radiation shielding on earth is achieved (mostly?) by the magnetic field that diverts the big particle cannon ammunition.