Breaking News
Who Will Find What the Finders Hide? Addendum
Seven Days in the Dark: How I Watched My Neighbors Turn Into Thieves...
Oracle Invokes Force Majeure on Project Jupiter AI Data Center
Something to Know About Saaaaaaafety
Top Tech News
Tesla Model 3 killer charges from 10 to 97% in just 9 minutes
World-first unpowered DNA computer sets speed record
I Power 5 Buildings Off-Grid. Here's How
The US government is pushing hard to get a working nuclear fission reactor into space by late 2028
SpaceX Starmind AI in Space Radiator
China Will Dominate Global Nuclear Energy Through 2035, Analyst Says
These Absolutely Wild-Looking EVs Are Saudi Arabia's First Homegrown Cars
BEYOND THE MOON: NASA plans a nuclear-powered fleet to push DEEPER into space
Big Oil Backs Mazama's $135 Million Bet On Superhot Geothermal
Quantum compass takes flight on Northrop's Lumberjack drone 
Three Eras of Machine Learning and Predicting the Future of AI
They show :
before 2010 training compute grew in line with Moore's law, doubling roughly every 20 months.
Deep Learning started in the early 2010s and the scaling of training compute has accelerated, doubling approximately every 6 months.
In late 2015, a new trend emerged as firms developed large-scale ML models with 10 to 100-fold larger requirements in training compute.
Based on these observations they split the history of compute in ML into three eras: the Pre Deep Learning Era, the Deep Learning Era and the Large-Scale Era . Overall, the work highlights the fast-growing compute requirements for training advanced ML systems.
They have detailed investigation into the compute demand of milestone ML models over time. They make the following contributions:
1. They curate a dataset of 123 milestone Machine Learning systems, annotated with the compute it took to train them.