Ampere teams up with Qualcomm to launch an Arm-based AI server

5 Min Read

Ampere and Qualcomm aren’t the obvious of companions. Each, in any case, supply Arm-based chips for working knowledge heart servers (although Qualcomm’s largest market stays cellular). However as the 2 corporations introduced in the present day, they’re now combining forces to supply an AI-focused server that makes use of Ampere’s CPUs and Qualcomm’s Cloud AI 100 Extremely AI inferencing chips for working — not coaching — fashions.

Like each different chip producer, Ampere is seeking to revenue from the AI increase. The corporate’s focus, nevertheless, has all the time been on quick and power-efficient server chips, so whereas it may use the Arm IP so as to add a few of these options to its chips, it’s not essentially a core competency. That’s why Ampere determined to work with Qualcomm (and SuperMicro to combine the 2 options), Arm CTO Jeff Wittich tells me.

“The concept right here is that whereas I’ll present you some nice efficiency for Ampere CPUs working AI inferencing on simply the CPUs, if you wish to scale out to even greater fashions — multi-100 billion parameter fashions, as an illustration — identical to all the opposite workloads, AI isn’t one dimension matches all,” Wittich advised TechCrunch. “We’ve been working with Qualcomm on this answer, combining our tremendous environment friendly Ampere CPUs to do a whole lot of the final objective duties that you just’re working along with inferencing, after which utilizing their actually environment friendly playing cards, we’ve received a server-level answer.”

Picture Credit: Ampere

As for partnering with Qualcomm, Wittich mentioned that Ampere needed to place collectively best-of-breed options.

See also  BrushNet: Plug and Play Image Inpainting with Dual Branch Diffusion

“[R]eally good collaboration that we’ve had with Qualcomm right here,” he mentioned. “This is among the issues that we’ve been engaged on, I feel we share a whole lot of actually related pursuits, which is why I feel that that is actually compelling. They’re constructing actually, actually environment friendly options and a whole lot of totally different elements of the market. We’re constructing actually, actually environment friendly options on the server CPU aspect.”

The Qualcomm partnership is a part of Ampere’s annual roadmap replace. A part of that roadmap is the brand new 256-core AmpereOne chip, constructed utilizing a contemporary 3nm course of. These new chips should not fairly typically out there but, however Wittich says they’re prepared on the fab and will roll out later this yr.

On prime of the extra cores, the defining characteristic of this new technology of AmpereOne chips is the 12-channel DDR5 RAM, which permits Ampere’s knowledge heart clients to raised tune their customers’ reminiscence entry in keeping with their wants.

The gross sales pitch right here isn’t simply efficiency, although, however the energy consumption and price to run these chips within the knowledge heart. That’s very true on the subject of AI inferencing, the place Ampere likes to match its efficiency in opposition to Nvidia’s A10 GPUs.

Picture Credit: Ampere

It’s price noting that Ampere will not be sunsetting any of its current chips in favor of those new ones. Wittich careworn that even these older chips nonetheless have loads of use instances.

Ampere additionally introduced one other partnership in the present day. The corporate is working with NETINT to construct a joint answer that pairs Ampere’s CPUs with NETINT’s video processing chips. This new server will be capable to transcode 360 reside video channels in parallel, all whereas additionally utilizing OpenAI’s Whisper speech-to-text mannequin to subtitle 40 streams.

See also  Cisco zooms in on new AI power for Webex teams

“We began down this path six years in the past as a result of it’s clear it’s the proper path,” Ampere CEO Renee James mentioned in in the present day’s announcement. “Low energy was synonymous with low efficiency. Ampere has confirmed that isn’t true. We now have pioneered the effectivity frontier of computing and delivered efficiency past legacy CPUs in an environment friendly computing envelope.”

Source link

Share This Article
Leave a comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Please enter CoinGecko Free Api Key to get this plugin works.