Breaking News
Addicted to Fake News Over the Real Thing
Hegemon USA and Apartheid Israel: Unparalleled Rogue States
Herbs for Pain Management: A Prepper's Herbal Medicine Cabinet
Sauna Benefits Deep Dive and Optimal Use with Dr. Rhonda Patrick & MedCram
Top Tech News
How Bamboo Towers in Africa Produce Free Water
CHEAP AND EASY DIY CHICKEN COOP!
NVIDIA released a new Eye Contact feature that uses AI to make you look into the camera.
Plasma Thrusters Ran at 500% Beyond Old Power Limits
Nikola Highlights its Integrated Hydrogen Solution, Introduces New Hydrogen Energy Brand "HYLA*
Tesla Will Have Abundant 4680 Batteries in a Few Years
CIA FUNDED COMPANY TO RESURRECT EXTINCT ANIMALS UNDER THE GUISE OF CLIMATE CHANGE
MightyFly's new autonomous cargo drone carries 100 lb for 600 miles
What search engine best at "Freedom-Respecting"?
A breakthrough system can see through walls by using Wi-Fi routers
Three Eras of Machine Learning and Predicting the Future of AI
They show :
before 2010 training compute grew in line with Moore's law, doubling roughly every 20 months.
Deep Learning started in the early 2010s and the scaling of training compute has accelerated, doubling approximately every 6 months.
In late 2015, a new trend emerged as firms developed large-scale ML models with 10 to 100-fold larger requirements in training compute.
Based on these observations they split the history of compute in ML into three eras: the Pre Deep Learning Era, the Deep Learning Era and the Large-Scale Era . Overall, the work highlights the fast-growing compute requirements for training advanced ML systems.
They have detailed investigation into the compute demand of milestone ML models over time. They make the following contributions:
1. They curate a dataset of 123 milestone Machine Learning systems, annotated with the compute it took to train them.