I would like to build a device...

Question

Hello reader,

Thank you for taking the time to read this post. I am a new member to Element14. I joined because I do not have a background in engineering, programming, or software design and I would like to build something that requires expertise in those fields. I hope the community is able to assist me in understanding how to best utilize this site and its resources. I'll give a short description of the idea below and several questions to start. Thank you for your help!

The Idea: A "low tech" augmented reality headset utilizing an FPV headset common with drones.

+ I need to attach a camera and any necessary peripherals for video processing to the headset. What would be the best method to do this.

+ I would also like to (if possible) connect the headset to a PC via bluetooth or an analog broadcast for processing the augmented reality overlay. What hardware would I need?

+ If I am correct, for the AR overlay to work ill need to triangulate the position of the headset as well. So would a local GPS work or would a gyrometer and accelerometer be needed?

jlangbridge · Answer

Hi there! And welcome to Element 14. Your project does indeed seem fairly complicated, but as with lots of electronic projects, if you cut it up into small pieces, it becomes easier. So, here is my way of seeing things. The headset will require a processor to handle all of this; you can try prototyping with a Raspberry Pi, or some other evaluation board with an on-board processor. Don't worry about size, later on this can be fixed.One question I have is about the link between the headset and the computer. What exactly do you have in mind? Is the PC a source of information, or is it the device that will generate the video? Bluetooth is an excellent way of linking devices, but it doesn't have the bandwidth necessary for video data (especially Bluetooth LE and derivates). Which means that if the PC provides information and not video, then the information must be processed on the headset (hence the processor). As for triangulation, a GPS will indeed tell you where you are, but only that. Car navigation systems can tell which direction you are facing only because they know where you were a few seconds ago, so a simple calculation is made. To know where you are, you need a GPS, but to know which way you are facing, then you will indeed need an accelerometer/compass. Remember, the hardest part is having an idea, the rest is somewhat easier. Plus, there are lots of very qualified members here who can help out!

koudelad · Answer

This article could provide some inspiration about processing power needed: https://software.intel.com/en-us/articles/using-intel-realsense-technology-in-combination-with-the-intel-edison-developm… If Bluetooth bandwidth is not sufficient, WiFi is an option.