Skip to main content

Want to shove 30 GPUs in a computer system? Here's an AI solution that will work as long as you are using Dell — Liqid allows one R760 server to connect to a whopping 30 Nvidia GPUs for now with AMD and Intel likely soon

Web Hosting & Remote IT Support

Composable infrastructure firm Liqid has created a cost-effective and scalable solution for organizations looking to deploy high-performance inference capabilities in their data centers. 

Unveiled at Dell Technologies World 2024, the UltraStack 30 crams a whopping thirty Nvidia L40S GPUs into a single Dell PowerEdge R760 server. 

Liqid previously released a technical whitepaper for its UltraStack server at Nvidia GTC 2024 and at that time it had only managed to jam up to 20 Nvidia L40S into a PowerEdge server, so that's quite a leap in a short amount of time.

AMD and Intel support coming

Nvidia L40S GPUs have fewer cores and are generally less powerful than Nvidia’s H100 and A100 accelerators, as well as the newer Blackwell GB200 and B200 systems. However, they are well-suited for a variety of high-performance tasks, including AI, data analytics, and 3D rendering. This makes them a versatile choice for modern data centers and professional workloads, and they are cheaper too. L40S typically cost $7,000 to $8,000, compared to H100s which can go for $25,000 to $30,000. 

The UltraStack 30 offers enhanced enterprise-level GPU infrastructure capabilities and builds on previous solutions, with improvements in operations per second and total cost of ownership compared to similar GPU density solutions. It also boasts an energy efficient design capable of delivering high-performance while reducing power consumption and operational costs.

This is just the start, and the company has big plans for the UltraStack 30. Sumit Puri, Liqid co-founder and chief strategy officer, noted, “As we move forward, we recognize that optimal memory bandwidth will be crucial for maximizing performance. This is why composableCXL (Compute Express Link) is on the horizon at Liqid, promising to further enhance our capabilities in delivering high-performance, low-latency solutions.”

Blocks & Files adds, “Our understanding is that Liqid can support GPUs and other accelerators from suppliers such as AMD and Intel. It is also aware of the possibility of marketing its SmartStack and UltraStack technologies to MSPs that wish to supply GPUs for rent.”

More from TechRadar Pro



via Hosting & Support
Labels:

Comments

Post a Comment

Web Hosting
Remote IT Support
Sites & Socials

Popular posts from this blog

AI tools are making social engineering attacks even more convincing, and I fear that this is only the beginning

Web Hosting & Remote IT Support Nick Park’s Wallace and Gromit were brought crashing into the 21st century in December 2024 with their latest adventure, Vengeance Most Fowl . The film challenges our growing dependence on smart technology in the form of a robotic garden gnome, built by Wallace to support his gardening business, which is then hacked by the Kubrick-esque Feathers McGraw for his own nefarious purposes. One of the more interesting but less commented on parts of the film shows Gromit cautiously entering his house and being greeted by what he thinks is Wallace’s reassuring voice, only to be confronted with Feathers and the robotic gnome. Technology’s ability to mimic linguistic patterns, to clone a person’s voice and understand and respond to questions has developed dramatically in the last few years. This has not gone unnoticed by the world’s criminals and scammers, with the result that social engineering attacks are not only on the rise but are more sophisticated a...
Post a Comment
Read more

Want a remote control for your smart home? SwitchBot has made a Matter-compatible one

Web Hosting & Remote IT Support SwitchBot has launched a unique piece of tech capable of controlling smart home devices and infrared appliances. And the best part is you don’t need to connect it to a smartphone or to the internet as it functions perfectly offline.  Aptly named the SwitchBot Universal Remote , it has large spacious buttons, a navigation wheel in the middle, and a 2.4-inch LCD at the top. The company states in their announcement it sought to create a “user-friendly design” that everybody can understand. Now, you can’t just point the Universal Remote at a device and then push a button to issue commands immediately. According to Android Central , you must first choose what you want to control, which can be done by pressing the center red button. Pressing the main button will let you change which group of smart home devices to control.  Universal Remote has launched! 🚀 Consolidate all your remotes, and control everything at home, even #automation! NOW,...
Post a Comment
Read more