element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • About Us
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Arduino
  • Products
  • More
Arduino
Blog #tinyML #MachineVision on the Arduino Portenta
  • Blog
  • Forum
  • Documents
  • Quiz
  • Events
  • Polls
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join Arduino to participate - click to join for free!
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: cgm11
  • Date Created: 22 Mar 2021 9:52 PM Date Created
  • Views 1843 views
  • Likes 6 likes
  • Comments 0 comments
  • portenta h7
  • ai at the edge
  • tinyml
  • machine vision
Related
Recommended

#tinyML #MachineVision on the Arduino Portenta

cgm11
cgm11
22 Mar 2021

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

Running Machine Vision on the Arduino Portenta + Vision Shield

 

What you see in this video is the Arduino Portenta running a Machine Vision algorithm to classify empty spaces and Lion / Jaguar figures. I wrote two detailed posts to explain how to achieve this in a fast and accurate way, see the links bellow and pay special attention to the second one because the training / correction / retraining process is what will allow you to achieve these levels of accuracy.

 

The portenta offers several options to work with #tinyML, you can use the mbed approach by using tensorFlow lite or you can use openMV which is nicely integrated to this board. I selected the second approach for two reasons; The first reason is that edgeImpulse provides a good support for this environment and the second reason is that openMV implements an amazing amount of features to work with old school computer vision techniques. Some of them are quite important for my project and they allow me to detect patterns on Jaguar fur. You have a lot of good tools such as blob detection, circle detections and several other features regarding background changes.

 

No matter the method you choose, the inferences will be executed on the M7 core which is pretty fast for the Job, in this example, you can see a pretty good metric of 3.4 Frames per Second with an accuracy of almost 100% on the classifications. The best part of this is that the model is able to classify Jaguars (real Jaguars) and even Jaguars in posters without including those samples on the training set.

 

image

 

There are many tools to work with tinyML but I think edgeImpulse has a lot of good tools to understand the dataset (see the graphical representation of features on the second post). Data is everything while working with ML and understanding data quality is a key to achieve these levels of accuracy. Edge Impulse is a free tool for developers and it also will help you to keep the interactive process under control by using their versioning control and other tools. It is also a quite productive tool because you will be able to use some predefined and optimized models to be runned on MCUs. If you saw my other posts, I develop my own models from scratch, however in this case, the predefined models (transfer learning for instance) work pretty well. You also have the option to edit these models by changing some parameters or by directly editing the Keras model using the expert mode.

 

To see the details please review these two short posts that will walk through the entire process, from data gathering to deployment and running the model on the Portenta!

 

  • https://www.wildedge.info/post/machine-vision-on-the-arduino-portenta-and-vision-shield-lora-part-i
  • https://www.wildedge.info/post/machine-vision-on-the-arduino-portenta-and-vision-shield-lora-part-ii

 

Cheers,

Carlos.

  • Sign in to reply
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube