This is not something you can train on a regular AWS gpu-instance without racking up millions of dollars in bills to my knowledge. Dataset isn't an issue its a capex issue.

It’s possible from scratch on not as much personally owned hardware as you’d think but will take a long time, months maybe.

Luckily, training from scratch will hopefully be obsoleted by fine-tuning - if someone else releases a generally capable model then you can turn that into another one for lower cost.