element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • About Us
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Experimenting with Sensor Fusion
  • Challenges & Projects
  • Design Challenges
  • Experimenting with Sensor Fusion
  • More
  • Cancel
Experimenting with Sensor Fusion
Blog Announcing the Winners of 'Experimenting with Sensor Fusion'
  • Blog
  • Forum
  • Documents
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join Experimenting with Sensor Fusion to participate - click to join for free!
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: rscasny
  • Date Created: 19 Jan 2023 9:38 PM Date Created
  • Views 147750 views
  • Likes 15 likes
  • Comments 12 comments
  • mmwave
  • experimenting with sensor fusion
  • AMD XILINX
  • sp701
  • lidar
  • winners
  • vslam
  • vivado
  • vitis hls
  • Visual Simultaneous Localization and Mapping
Related
Recommended

Announcing the Winners of 'Experimenting with Sensor Fusion'

rscasny
rscasny
19 Jan 2023

imageThe Experimenting with Sensor Fusion Design Challenge, sponsored by AMD Xilinx, and featuring Spartan-7 SP701 FPGA Evaluation Kit  has officially concluded. We had 4 participants, including the Grand Prize Winner and Runner-up. Our judges have read each blog and tallied up the final scores, and element14 is ready to announced the winners. In this blog, I'll review the program (for newcomers) and announce the winners with a summary and links to their work.

imageA Quick Review: What is Sensor Fusion?
Sensors are an extension of the five human senses. They allow us to perceive the world and often observe details to a degree that our human senses cannot. However, in some situations, they still fall short of the user requirements, regardless of how well they perform. For example, in an automobile, a LIDAR sensor can determine whether there is an obstacle ahead. But if you want to know the exact nature of the obstacle, you also need an on-board camera. Moreover, if you want to sense the motion state of this object, you'll also need a millimeter-wave (mmWave) radar.

When multiple pieces of information on the features of the object are integrated, a more complete and accurate picture can be derived for system operation. This method of integrating multiple sensors is called “sensor fusion.”

By definition, sensor fusion is the use of computer technology to automatically analyze and synthesize information and data from multiple sensors or sources under certain criteria to conduct the information processing required for making decisions and estimations.

Two common types of sensor fusion are image and motion sensor fusion, used in automotive surround view and navigation applications, respectively. Other uses could include (a) determining the orientation of a system in three-dimensional space, or (b) trackers where their data is fused with data from wearable heart rate monitors, temperature sensors, etc. as part of telehealth services or remote monitoring of patient conditions

What is the Experimenting with Sensor Fusion Design Challenge?
element14's Experimenting with Sensor Fusion is a hands-on competition for electronic engineers.  The participants had the opportunity to receive a sensor fusion dev kit from our sponsor FREE of charge. They were challenged to conduct experiments and blog about what they learned. Their blogs would be judged for technical merit and creativity. The top two participants would receive some great prizes.

Who are the Winners of the Experimenting with Sensor Fusion Design Challenge?
Our four participants conducted experiments and produced 13 technical blogs. Our judges have made their decisions, so let's meet the winners!

  • Grand Prize Winner of the Experimenting with Sensor Fusion Challenge: javagoza

Heads Up Display Prototypejavagoza is currently a back-end software developer for payment solutions in the payment card industry, specializing in PCI and EMV compliance. He had said on his application that the main reason he was interested in the Experimenting with Sensor Fusion program was to "learn more about FPGA design and image processing applications."

He experimented with building a prototype for a portable alert monitor that provides heads up display information for firefighters. He built the system in stages and experimented with new sensors and integrated them into the system. The sensors included, the Pcam 5C camera, 5MP fixed focus color camera module, various HDMI displays, the Pmod NAV module, 9-axis IMU plus barometer, the Pmod HYGRO module, digital humidity and temperature sensor, the Pmod CMPS2 Module, 3-Axis Compass, the SparkFun Environmental Combo Breakout Module(CCS811 Equivalent CO2 and Total Volatile Organic Compounds and BME280, Humidity, Temperature and Barometric Pressure) and finally the SparkFun IR Array Breakout: 110 degree FOV, MLX90640, Sensor Array Thermopile 32x24.

Heads Up Display PrototypeHe also experimented with the different functionalities of the AMD Xilinx Vivado development environment taking advantage of the hardware accelerators with the Spartan-7 FPGA. The system combines a thermal array sensor, real video image, a magnetometer compass, and the IMU to detect movement and orientation of the head and a time-of-flight (ToF) sensor to estimate the distance to nearby objects. With respect to the SP701 development board, javagoza said, "The SP701 board makes prototyping solutions based on the Spartan-7 FPGA really easy." He designed the hardware, a heads display block IP, using high level synthesis tools (Vitis HLS). He used different IP blocks provided by Xilinx within the Vivado Block Designer and built other software drivers with Vitis IDE. One of our judges called javagoza's blogs as "an excellent set of posts."

You can read all of his blogs here. 

  • Runner Up Prize Winner of the Experimenting with Sensor Fusion Challenge: _david_

_david_ is a 2021 graduate with a background in computer engineering and a concentration in robotics. He's worked with Xilinx FPGA's for about 2 years. He started out by interfacing MIPI CSI cameras in bare metal, then progressively switched over to embedded Linux where he learned how to use XRT to deploy accelerated computer vision applications for drones.

His goal for this challenge was to implement some kind of sensor fusion application. Initially, he wanted to do experiments around Visual-Inertial Odometry (VIO), a type of sensor fusion which uses image sensors and IMU data to compute the position and orientation of an object. But due to time constraints, he chose instead only to take on part of this problem, namely the inertial odometry part.

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

He planned on collecting data from an IMU and accelerate the computation of an object's pose. Once computed, he would generate a visualization of a set of unit vectors which will be fused with a live camera feed. In essence, this is an augmented reality (AR) application which will attempt to project the pose of an object in real time. He calls it a "drone pose" because drones are probably the best example of a rigid body robot that experiences linear and angular accelerations. At a high level, he wanted to be able to collect data from an IMU in order to calculate the pose of a rigid body and then represent it as a coordinate frame on a live camera feed.

One of our judges said, his blogs were "well-explained and he didn't try to do an excessive amount, and his two blogs were clear. The bulk of the content was in the second blog, which actually explains a lot to people new to the technology. I'd rate his content very high."

You can read all of his blogs here. 

I'd like to thank all the element14 members who participated in this challenge:

jwr50 - FGPA-based VSLAM for Indoor Navigation
He explored Visual Simultaneous Localization and Mapping (VSLAM) for indoor spaces. VSLAM is a class of algorithms that combines images sequences with pose information to construct a map of a device’s surroundings and at the same time estimate the location within that map. This technique is well suited for indoor environments where GPS is unavailable and in the absence of other positioning markers, beacons, etc. You can read his blogs here.

guillengap - Sensor Fusion Bird Detector
He attempted to develop a bird detector prototype with the Spartan-7 SP701 FPGA Evaluation Kit. He was motivated to take on this challenge because there is a great diversity of migratory birds in his area, so he wanted to experiment with pigeons, ravens, swallows and hummingbirds, since they have different types of behaviors. You can read his blogs here.

Last Word: A Big Thank You to Our Judges!

We'd like to thank Top Members Don Bertke and Shabaz for judging the Experimenting with Sensor Fusion Challenge! Their input on the projects was invaluable to our final decisions.

  • Sign in to reply

Top Comments

  • genebren
    genebren over 2 years ago +1
    Congratulations to the winners! I was very impressed with the both the Grand and Runner Up projects, but I would agree with the judges that javagoza did an amazing job and is a well deserved Grand Prize…
  • shabaz
    shabaz over 2 years ago +1
    Congrats to the winners! They are great projects.
  • robogary
    robogary over 2 years ago +1
    As always, incredible well done projects. Congrats.
  • dougw
    dougw over 2 years ago

    Congratulations winners!

    Well done - FPGA projects require lots of knowledge and significant work.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • _david_
    _david_ over 2 years ago

    This was such an unreal experience!  Thank you Element14 for organizing this event and for giving me such an awesome opportunity!


    @javagoza, I was blown away by the scope of your project and how well executed it was, this was really well deserved!  Keep up the work with the great blogs, it's articles like yours that really helped me find my way in this field!


    And thank you everyone for all the kind comments, whether it was Randall, the judges, or members of the community.  I was worried that this might not be well-received, so I found your feedback really uplifting, thank you!

    • Cancel
    • Vote Up +1 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • redcharly
    redcharly over 2 years ago

    Great projects!! 

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • amgalbu
    amgalbu over 2 years ago

    Congratulations to the winners!

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • BigG
    BigG over 2 years ago

    Congratulations to all participants who completed this challenges and to the winners. Very impressive projects. Well done.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube