Skip to main content

Nvidia is powering a mega Tesla supercomputer powered by 10,000 H100 GPUs

Web Hosting & Remote IT Support

Tesla has revealed its investment into a massive compute cluster comprising 10,000 Nvidia H100 GPUs specifically designed to power AI workloads.

The system, which went online this week, is designed to process the mountains of data its fleet of vehicles collect with a view to accelerating the development of fully self-driving vehicles, according to its leader of AI infrastructure, Tim Zaman.

Tesla has been striving for years to reach the point at which its vehicles can be considered entirely autonomous and has invested more than a billion dollars into adopting the infrastructure to make this possible.

Tesla supercomputer

In July 2023, CEO Elon Musk revealed the firm would invest $1 billion into building out its Dojo supercomputer over the next year. Dojo, which is based on Tesla’s own tech, began with the D1 chip, fitted with 354 custom CPU cores. Each training tile module comprises 25 D1 chips, with the base Dojo V1 configuration including 53,100 D1 cores in total.

The firm also built a compute cluster fitted with 5,760 Nvidia A100 GPUs in June 2012. But the firm’s latest investment in 10,000 of the company’s H100 GPUs dwarfs the power of this supercomputer. 

This AI cluster, worth more than $300 million, will offer a peak performance of 340 FP64 PFLOPS for technical computing and 39.58 INT8 ExaFLOPS for AI applications, according to Tom’s Hardware. 

The power at Tesla’s disposal is actually more than that offered by the Lenoardo supercomputer, the publication pointed out, making it one of the most powerful computers on the planet.

Nvidia’s chips are the components that power many of the world’s leading generative AI platforms. These GPUs, which are fitted into servers, have several other use cases from medical imaging to generating weather models.

Tesla is hoping to use the power of these GPUs to more efficiently and effectively churn through the vast quantities of data it has to build a model that can successfully rival a human.

While many businesses would usually lean on infrastructure hosted by the likes of Google or Microsoft, Tesla’s supercomputing infrastructure is all on-prem, meanig the firm will also have to maintain all of it.

More from TechRadar Pro



via Hosting & Support
Labels:

Comments

Post a Comment

Web Hosting
Remote IT Support
Sites & Socials
Computing Handbook - $9.95

Popular posts from this blog

Microsoft, Google, and Meta have borrowed EV tech for the next big thing in data centers: 1MW watercooled racks

Web Hosting & Remote IT Support Liquid cooling isn't optional anymore, it's the only way to survive AI's thermal onslaught The jump to 400VDC borrows heavily from electric vehicle supply chains and design logic Google’s TPU supercomputers now run at gigawatt scale with 99.999% uptime As demand for artificial intelligence workloads intensifies, the physical infrastructure of data centers is undergoing rapid and radical transformation. The likes of Google, Microsoft, and Meta are now drawing on technologies initially developed for electric vehicles (EVs), particularly 400VDC systems, to address the dual challenges of high-density power delivery and thermal management. The emerging vision is of data center racks capable of delivering up to 1 megawatt of power, paired with liquid cooling systems engineered to manage the resulting heat. Borrowing EV technology for data center evolution The shift to 400VDC power distribution marks a decisive break from legacy sy...
Post a Comment
Read more

The Apple Watch ban is lifted, on appeal – but the reprieve might only be temporary

Web Hosting & Remote IT Support The Apple Watch ban story has developed quickly over the last week and a bit, and there's now a new twist: the US Court of Appeals is putting a pause on the US sales and import ban while it reviews the case, which means the Apple Watch 9 and Apple Watch Ultra 2 can go back on sale for the time being. "We are thrilled to return the full Apple Watch lineup to customers in time for the new year," an Apple spokesperson told TechRadar. "We are pleased the US Court of Appeals for the Federal Circuit has stayed the exclusion order while it considers our request to stay the order pending our full appeal." The watches in question are now once again available from "select" Apple Stores, and will also be going on sale from the Apple website from 12pm PT / 3pm ET on Thursday, December 28 (that's 8pm in the UK, and early on December 29 in Australia). All Apple Stores should have stock by the weekend. As for how long t...
Post a Comment
Read more

The Samsung Galaxy Ring could go into production as soon as next month

Web Hosting & Remote IT Support With the dust beginning to settle from the huge Samsung Unpacked 2023 event, we can turn our attention towards what Samsung might have planned next: and a smart ring seems to be in the company's near future. As per a report from South Korean outlet The Elec (via SamMobile ), mass production on a Samsung Galaxy Ring could begin as early as August, with a decision imminent on the schedule for getting the wearable manufactured and out to consumers. A full launch is slated for some point during 2024 though, rather than 2023. The nature of the device means that it'll need to clear several regulatory hurdles before it can go on sale and start tracking various vital statistics. An early 2024 launch would put the Galaxy Ring on a similar schedule to the Samsung Galaxy S24 – and it would therefore make sense to launch both gadgets at the same time, perhaps in January or February if Samsung follows its 2023 routine. The story so far Rumors ar...
Post a Comment
Read more