Breaking News
Joe Rogan Experience #2246 - James Fox
Just a fraction of the hydrogen hidden beneath Earth's surface could power Earth for 200 years..
Will Russia Collapse in 2025?
SpaceX Tests New Heat Shield and Adds Tanks for Engine Restarts
Top Tech News
7 Electric Aircraft That Will Shape the Future of Flying
Virginia's fusion power plant: A step toward infinite energy
Help us take the next step: Invest in Our Vision for a Sustainable, Right-to-Repair Future
Watch: Jetson founder tests the air for future eVTOL racing
"I am Exposing the Whole Damn Thing!" (MIND BLOWING!!!!) | Randall Carlson
Researchers reveal how humans could regenerate lost body parts
Antimatter Propulsion Is Still Far Away, But It Could Change Everything
Meet Rudolph Diesel, inventor of the diesel engine
China Looks To Build The Largest Human-Made Object In Space
Ferries, Planes Line up to Purchase 'Solar Diesel' a Cutting-Edge Low-Carbon Fuel...
Tesla Dojo, Supercomputers and AI
There does not seem to be a limit for neural nets to utilize more resources to get better and faster results.
Tesla is motivated to develop bigger, faster computers that are precisely suited to their needs.
The Google TPU architecture has not evolved as much over the last 5 years. The Google TPU chip is designed for the problems that Google runs. They are not optimized for training AI.
Tesla has rethought the problem of AI training and designed the Dojo AI supercomputer to optimally solve their problems.
If Tesla commercializes the AI supercomputer that will help to get to lower costs and greater power with more economies of scale.
One of the reasons that TSMC overtook Intel was that TSMC was making most of the ARM chips for cellphones. TSMC having more volume let them learn faster and drive down costs and accelerate technology.
99% of what neural network nodes do are 8 by 8 matrix multiply and 1% that is more like a general computer. Tesla created a superscalar GPU to optimize for this compute load.