Skip to main content

This startup wants to take on Nvidia with a server-on-a-chip to eliminate what it calls an already flawed system — faster GPU, CPU, LPU, TPU or NIC will not deliver the leap that many firms are aiming for

Web Hosting & Remote IT Support

According to Israeli startup NeuReality, many AI possibilities aren't fully realized due to the cost and complexity of building and scaling AI systems. 

Current solutions are not optimized for inference and rely on general-purpose CPUs, which were not designed for AI. Moreover, CPU-centric architectures necessitate multiple hardware components, resulting in underutilized Deep Learning Accelerators (DLAs) due to CPU bottlenecks.

NeuReality's answer to this problem is the NR1AI Inference Solution, a combination of purpose-built software and a unique network addressable inference server-on-a-chip. NeuReality says this will deliver improved performance and scalability at a lower cost alongside reduced power consumption.

An express lane for large AI pipelines

“Our disruptive AI Inference technology is unbound by conventional CPUs, GPUs, and NICs," said NeuReality’s CEO Moshe Tanach. "We didn’t try to just improve an already flawed system. Instead, we unpacked and redefined the ideal AI Inference system from top to bottom and end to end, to deliver breakthrough performance, cost savings, and energy efficiency."

The key to NeuReality's solution is a Network Addressable Processing Unit (NAPU), a new architecture design that leverages the power of DLAs. The NeuReality NR1, a network addressable inference Server-on-a-Chip, has an embedded Neural Network Engine and a NAPU.

This new architecture enables inference through hardware with AI-over-Fabric, an AI hypervisor, and AI-pipeline offload.

The company has two products that utilize its Server-on-a-Chip: the NR1-M AI Inference Module and the NR1-S AI Inference Appliance. The former is a Full-Height, Double-wide PCIe card that contains one NR1 NAPU system-on-a-chip and a network-addressable Inference Server that can connect to an external DLA. The latter is an AI-centric inference server containing NR1-M modules with the NR1 NAPU. NeuReality claims the server “lowers cost and power performance by up to 50X but doesn’t require IT to implement for end users.”

“Investing in more and more DLAs, GPUs, LPUs, TPUs… won’t address your core issue of system inefficiency,” said Tanach. “It's akin to installing a faster engine in your car to navigate through traffic congestion and dead ends - it simply won't get you to your destination any faster. NeuReality, on the other hand, provides an express lane for large AI pipelines, seamlessly routing tasks to purpose-built AI devices and swiftly delivering responses to your customers, while conserving both resources and capital.”

NeuReality recently secured $20 million in funding from the European Innovation Council (EIC) Fund, Varana Capital, Cleveland Avenue, XT Hi-Tech and OurCrowd.

More from TechRadar Pro



via Hosting & Support
Labels:

Comments

Post a Comment

Web Hosting
Remote IT Support
Sites & Socials

Popular posts from this blog

Last orders! Breville’s Birthday Sale ends in 24 hours – save an extra 10% on already-discounted espresso machines with our exclusive code

Web Hosting & Remote IT Support It’s been a busy month for coffee machine maestro, Breville. Not only did it celebrate International Coffee Day at the start of the month, but this October is also the company’s birthday month. And to mark the occasion, you can save up to AU$550 on a range of top-performing espresso machines . And that’s not all, as you can save a further 10% on discounted models with our exclusive Breville coupon code . Alternatively, you can use our exclusive promo code sitewide on the complete range of Breville appliances. You’ll need to hurry though, as the Breville Birthday Sale comes to a close at 11:30pm AEDT 21 October. Breville is, of course, responsible for some of the best coffee machines in Australia , and as a result, it can make choosing the ideal model for your household a little bit trickier. To help guide you to cafe-quality coffee at home, I’ve picked out so...
Post a Comment
Read more

Mova V70 Ultra Complete review: a full-featured robovac let down by subpar performance

Web Hosting & Remote IT Support Mova V70 Ultra Complete: Two-minute review If you've never heard of Mova as a brand, you're not alone as it was initially only available in select European and South-East Asian countries. The brand, which is owned by Dreame Technology, is now expanding and is supposed to be value-focused side of the company — although you'd be hard pressed to believe that when its latest flagship robot vacuum costs upwards $1,000 / £1,000 / AU$3,000. However, the Mova V70 Ultra Complete brings everything you expect from such an expensive robovac, including some industry-first features that are now being adopted by other brands. This includes suction that's a whopping 42,000Pa at its maximum, as well as the impressively long reach of the side brush and mopping arm (12cm and 17cm respectively). I even love the fact that it eliminates the need for dust bags by us...
Post a Comment
Read more

UK small businesses are spending big on Anthropic — but OpenAI isn't far behind as expenditure on AI tools hits new high

Web Hosting & Remote IT Support An estimated 1 out of every 8 UK small and medium businesses are paying for AI tools Over 28% of SMEs are using two or more AI platforms Publishing is the main UK sector adopting AI British SMEs are moving toward AI solutions, with adoption increasing from 1.1% in 2023 to 12.8% in 2026, new research has claimed. The study , by small business credit card providers Capital on Tap, also shows that while smaller companies may have more modest budgets, they’re still happy to spread their bets when it comes to choosing an AI solution. Over 28% of SMEs are using multiple AI platforms – with Anthropic’s Claude just edging out OpenAI’s ChatGPT, with the average quarterly spend growing to a quarterly average of £75.60 per SME. SMEs explore AI Anthropic is the most popular AI provider among British SMEs according to the research, with those businesses devoting 54.1% of ...
Post a Comment
Read more