Breaking News
BANK OF AMERICA SURRENDERS: BofA Just Issued a $309 Silver Alert (Physical Premiums Exploding)
Steve Witkoff says they are close to finishing "a prosperity agreement" for Ukraine,...
NOW - Starmer says a declaration of intent has been signed...
Remarks at the New Jersey Bankers Association, Jersey City, New Jersey
Top Tech News
The First Production All-Solid-State Battery Is Here, And It Promises 5-Minute Charging
See inside the tech-topia cities billionaires are betting big on developing...
Storage doesn't get much cheaper than this
Laser weapons go mobile on US Army small vehicles
EngineAI T800: Born to Disrupt! #EngineAI #robotics #newtechnology #newproduct
This Silicon Anode Breakthrough Could Mark A Turning Point For EV Batteries [Update]
Travel gadget promises to dry and iron your clothes – totally hands-free
Perfect Aircrete, Kitchen Ingredients.
Futuristic pixel-raising display lets you feel what's onscreen
Cutting-Edge Facility Generates Pure Water and Hydrogen Fuel from Seawater for Mere Pennies
Tesla Dojo, Supercomputers and AI
There does not seem to be a limit for neural nets to utilize more resources to get better and faster results.
Tesla is motivated to develop bigger, faster computers that are precisely suited to their needs.
The Google TPU architecture has not evolved as much over the last 5 years. The Google TPU chip is designed for the problems that Google runs. They are not optimized for training AI.
Tesla has rethought the problem of AI training and designed the Dojo AI supercomputer to optimally solve their problems.
If Tesla commercializes the AI supercomputer that will help to get to lower costs and greater power with more economies of scale.
One of the reasons that TSMC overtook Intel was that TSMC was making most of the ARM chips for cellphones. TSMC having more volume let them learn faster and drive down costs and accelerate technology.
99% of what neural network nodes do are 8 by 8 matrix multiply and 1% that is more like a general computer. Tesla created a superscalar GPU to optimize for this compute load.