Under current growth rates, and assuming training remains roughly compute-optimal, Epoch projects the world’s stock of quality training data will be exhausted between 2026 and 2032
Read more at: What Happens When Models Run Out of Data? - VAST Data
What are your thoughts? Did you learn something new? Do you agree with this take?