Experimenting with Sensor Fusion: Augmented Reality - Drone Pose (Blog #2)

RE: Experimenting with Sensor Fusion: Augmented Reality - Drone Pose (Blog #2)

shabaz — Mon, 09 Jan 2023 17:50:44 GMT

I'm new to this topic and didn't really understand it initially. I was confused, where was the HDL : ) Then I realized, that Vitis HLS accepts C code and generates its own HDL.

I too was wondering about this point that you mentioned, i.e. how Vitis HLS is made aware of the amount of resouces that you wish to throw at the problem, since you may want to keep more resources for other parts of the project:

"A lot of times Vitis HLS over-optimizes in my opinion. Something like cv::projectPoints just needs to run at 33ms, but Vitis HLS will try to do it in like 330ns. I tried things like #pragma HLS latency min=10000 to try to allow for more forgiving optimizations, but it never seemed to do anything."

I wish that FPGA accelerators with Vitis HLS were somehow available as add-on processors for normal ARM SBCs, i.e. let the user completely write their code in C/C++ and during the build process, push off things that need accelerating into that imaginary add-on device : )

RE: Experimenting with Sensor Fusion: Augmented Reality - Drone Pose (Blog #2)

flyingbean — Mon, 09 Jan 2023 01:59:57 GMT

Great job. A question for Task #1:unaccelerated OpenCV application: What tool did you run the unacceletared OpenCV application as a prototype before using FPGA HLS acceleration? I think the FPGA HLS acceleration need to match with the prototype design to some degree.

RE: Experimenting with Sensor Fusion: Augmented Reality - Drone Pose (Blog #2)

dougw — Sun, 08 Jan 2023 15:14:05 GMT

It looks pretty responsive - well done.