Actions
Forum Thread Details
  • Replies 7 replies
  • Subscribers 558 subscribers
  • Views 2237 views
  • Users 0 members are here
Related

Xilinx Vitis-AI - Who is using this framework ?

albertabeef

Hello all,

 

I have been fairly busy creating designs that make use of Vitis-AI, Xilinx's development framework for AI.

 

I wanted to know how many users are using Vitis-AI ?

 

What type of project or tutorial would you like to see based on Vitis-AI ?

 

Regards,

 

Mario Bergeron.

Parents

  • Hi Mario,

     

    I'm surprised that you haven't gotten a lot of responses to this post as I know that there are a lot of Xilinx users in the E14 community.

     

    I've really appreciated the Vitis-AI posts that you've done on Hackster.  I've been taking a break from the Xilinx FPGAs and been focusing on TinyML, so I haven't tried your latest Vitis-AI 1.3 stuff yet.

     

    I've had problems using the IP cameras with the VCU and GStreamer on the UtraZed-EV.  I'll probably get back to working on this later this summer.  Have you done much with the VCU?  Has anyone replaced Jason Moss after he left Avnet to go to Xilinx?  I think he was the resident expert.  It would be great to see projects integrating the VCU and GPU.

     

    Ralph

  • in reply to ralphjy

    Ralph,

    Thank you very much for the reply and feedback.
    I am a VCU newbie, so will defer to Dan's response on the status of the VCU.

    Can you clarify what you would like to see with the GPU ?

     

    Regards,

    Mario.

  • in reply to albertabeef

    I was and still will be trying to implement an AI augmented NVR using multiple IP cameras for detection and identification.  There are the details of handling the decoded VCU output into the GPU and also trying to process multiple streams with the GPU.  Have you done anything using multiple video streams - webcam or recorded video?

     

    I've been interested in Edge AI and now TinyML.  I thought that I could use lower resolution less capable camera modules with TinyML to do detection and use those results to determine which high resolution streams the UltraZed-EV should process for identification.

     

    Not trying to build a product, just like trying out new technologies.  I'm sure the ADAS systems have much more complex configurations working.  Is there a Quadcam example using the GPU?

Reply
  • in reply to albertabeef

    I was and still will be trying to implement an AI augmented NVR using multiple IP cameras for detection and identification.  There are the details of handling the decoded VCU output into the GPU and also trying to process multiple streams with the GPU.  Have you done anything using multiple video streams - webcam or recorded video?

     

    I've been interested in Edge AI and now TinyML.  I thought that I could use lower resolution less capable camera modules with TinyML to do detection and use those results to determine which high resolution streams the UltraZed-EV should process for identification.

     

    Not trying to build a product, just like trying out new technologies.  I'm sure the ADAS systems have much more complex configurations working.  Is there a Quadcam example using the GPU?

Children
  • in reply to ralphjy

    Ralph,

    Which frameworks are you using for your experimentation ?
    If you are using gstreamer, you may want to check if there are already gstreamer plug-ins that make use of the MALI GPU.

    The only thing I did with graphics was to use the RGBA layer of the video mixer to display a static image with transparent regions,
    combined with the other video mixer layers that were displaying live content via gstreamer.

    Mario.