Seeking Suggestions for Sensors to Add To Xlinix Spartan-7 FPGA Kit for Sensor Fusion Projects

RE: Seeking Suggestions for Sensors to Add To Xlinix Spartan-7 FPGA Kit for Sensor Fusion Projects

saadtiwana_int — Mon, 15 Aug 2022 01:31:07 GMT

Talking of sensor fusion, i think of what sensors would actually make sense fusing together.

Imaging Sensor fusion (Visible + Infrared):

PCAM-5C (can be used with MIPI CSI connector on the SP701)

https://my.element14.com/digilent/410-358/camera-module-image-sensor-board/dp/2987302?st=pcam

MLX90640 thermal sensor (can be connected via one of the PMODs ) -

https://shop.pimoroni.com/products/mlx90640-thermal-camera-breakout?variant=12536948654163

Alternatively, for higher resolution infrared data, a module based on Flir Lepton can be considered.

For output, of-course the HDMI can be used, but may I suggest adding a compatible MIPI-DSI LCD instead? Reason being, this is one interface that is getting increasingly more important for those working with imaging systems, but I don't find many projects using the DSI interface with Xilinx boards. Xilinx even made the DSI IP free of charge few years ago. Perhaps the sponsor (I assume Xilinx) can suggest a compatible LCD since it's not very common. The SP701 has a MIPI DSI port btw.

InertialState Estimation/Navigation sensor fusion:

Fusing data from Gyros, accelerometers, magnetometer by means of various filters to get accurate inertial state estimation is in-itself a decent task. The following sensor has all of those sensors + barometer, and can be used for such.

https://my.element14.com/digilent/410-326/pmod-board-9-axis-imu-plus-barometer/dp/2726217?CMP=e14c-noscript&COM=e14c-noscript

In addition, a GPS sensor can be added, fusing the data with the state estimate from previous and barometer data to build a full navigation system.

https://my.element14.com/digilent/410-237/peripheral-mod-gps-receiver/dp/2211777

RE: Seeking Suggestions for Sensors to Add To Xlinix Spartan-7 FPGA Kit for Sensor Fusion Projects

wolfgangfriedrich — Mon, 08 Aug 2022 19:03:34 GMT

I'd like to see some resistive flex sensors being used. They would enable nice visualization of orientation of flexible objects like fingers.

And I like Doug's idea of microphone arrays.

RE: Seeking Suggestions for Sensors to Add To Xlinix Spartan-7 FPGA Kit for Sensor Fusion Projects

dougw — Mon, 08 Aug 2022 17:45:25 GMT

Azure Kinect Developer Kit or perhaps a Orbbec Astra 3D Camera. Not for the faint of heart, but 3D imaging is an application worthy of Spartan.

Another decent application might be a beam-forming microphone array. (I think the new Kinect has one built-in).

LIDAR also comes to mind.

Ultra wideband RADAR modules also have a lot of potential.

RE: Seeking Suggestions for Sensors to Add To Xlinix Spartan-7 FPGA Kit for Sensor Fusion Projects

javagoza — Mon, 08 Aug 2022 17:43:41 GMT

Some suggestions, for video, sound, environmental and IMU

[embed:ad4490ac-0ce8-4f2d-a04c-9285646d5689:dcb2fc5e-9ba0-4c00-9471-911c56f3fe1d:text=Add-On%20Board%2C%20Pcam%205C%20Camera%20Module%2C%20OV5640%20Colour%20Sensor%2C%205%20MP%2C%20For%20FPGA%20Development%20Boards&style=link&farnell=2987302&newark=40AH1670&cpc=&avnetemea=&avnetema=&avnetasia=&comoverride=&cmpoverride=&AreaInteracted=rte-content&bom=]

[embed:ad4490ac-0ce8-4f2d-a04c-9285646d5689:c93916a1-aa7f-4441-b706-514631b1df8b:text=Add-On%20Board%2C%20AQS%20Digital%20Gas%20Sensor%20Pmod%20Module%2C%20AMS%20CCS811%20Sensor%2C%20I2C%20Interface&style=link&farnell=3003248&newark=97AC8764&cpc=&avnetemea=&avnetema=&avnetasia=&comoverride=&cmpoverride=&AreaInteracted=rte-content&bom=]

[embed:ad4490ac-0ce8-4f2d-a04c-9285646d5689:bc05e77d-88e7-4a70-9403-b5174dd6cd37:text=9%20Axis%20IMU%2C%20Barometer%2C%20Pmod%20NAV%2C%2010%20DOF%20Functionality&style=link&farnell=2726217&newark=40AH1644&cpc=&avnetemea=&avnetema=&avnetasia=&comoverride=&cmpoverride=&AreaInteracted=rte-content&bom=]

[embed:ad4490ac-0ce8-4f2d-a04c-9285646d5689:702b5b99-9867-4843-ae2d-fad2a9280b12:text=PMOD%20MIC3%20MEMS%20MICROPHONE%20WITH%20ADJ%20GAIN&style=link&farnell=3408876&newark=69AH4841&cpc=&avnetemea=&avnetema=&avnetasia=&comoverride=&cmpoverride=&AreaInteracted=rte-content&bom=]

An IR thermal array like this one that I have used in this project has also seemed very interesting to combine with other sensors.

Arty S7 50 VGA Thermal Imaging Camera - Blog - FPGA - element14 Community