Path to Programmable 3

Forum As I experiment with reconfigurable risc v cores, is there tensor acceleration for LLM and diffusion network ai models on the FPGA fabric?

Join Path to Programmable 3 to participate - click to join for free!

Actions

Forum Thread Details

Replies 2 replies
Subscribers 126 subscribers
Views 1407 views
Users 0 members are here

Related

As I experiment with reconfigurable risc v cores, is there tensor acceleration for LLM and diffusion network ai models on the FPGA fabric?

rscasny over 2 years ago

I had some email me with this question:

As I experiment with reconfigurable risc v cores, is there tensor acceleration for LLM and diffusion network ai models on the FPGA fabric?

Top Replies

wolfgangfriedrich over 2 years ago +1

Bingo.

wolfgangfriedrich over 2 years ago

Bingo.
Cancel
Vote Up +1 Vote Down

Sign in to reply

Cancel
shabaz over 2 years ago

Hi,

Although it's technically possible for someone to implement this, I don't think it would be very efficient to do this in the FPGA cells. There are better options, which would be (for instance) to use an AMD Zynq type part (i.e. with processing subsystem) and attach an accelerator module, using say AMD PCIe IP https://www.xilinx.com/products/technology/pci-express.html . Example is Google's accelerator module, but actually obtaining that could be a challenge (due to semiconductor shortage). I've been waiting 4 months just to get hold of a small quantity (3) of the Google accelerators, and no promised date. Maybe it's easier to obtain if there is a requirement for large volumes perhaps, but I don't know : (
Cancel
Vote Up 0 Vote Down

Sign in to reply

Cancel