I think there is a mistake with the trained data size.

I think, there is a mistake. ChatGPT 3 is trained on 45 terabytes NOT GB. ChatGPT 4 is trained on 1 petabyte, see minutes 02:03.