element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • About Us
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
FPGA
  • Technologies
  • More
FPGA
Polls Poll: Seeking Your Interest in Sound Classification and Vision Object Detection WorkShop
  • Blog
  • Forum
  • Documents
  • Quiz
  • Events
  • Polls
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join FPGA to participate - click to join for free!
Actions
  • Share
  • More
  • Cancel
Engagement
  • Author Author: rscasny
  • Date Created: 25 May 2021 9:50 PM Date Created
  • Last Updated Last Updated: 11 Oct 2021 3:00 PM
  • Views 574 views
  • Likes 1 like
  • Comments 3 comments
Related
Recommended

Poll: Seeking Your Interest in Sound Classification and Vision Object Detection WorkShop

I was speaking with a supplier who may be interested in conducting an AI workshop on Sound Classification and Vision Object Detection. This workshop sparked my interest because it combines two senses, which I found unique. But you tell me. I have pasted below the working draft of this workshop. Id like to know if it captures your interest and to what degree. If you have any other ideas or "tweaks" to the proposal, feel free to post a comment below. Thanks.

 

Title: Does Your Application Need Better Eyes and Ears?

 

Description:

Today’s products are becoming more sophisticated as they better understand the world around them. The technology making this possible is AI leveraging neural networks. Today, these networks are being used for a wider variety of tasks and do not require cloud resources. Xilinx MPSoCs make this possible by more efficiently processing these networks at the edge while offering standard Linux software (Ubuntu) and popular AI framework environments (Keras) that AI and embedded developers are familiar with.

 

Product teams are also discovering that the use of these networks, that process different types of sensor data such as microphones and cameras, can take on more sophisticated tasks and produce more reliable results. This workshop brings together a confluence of vision and sound AI models that when used together enable more intelligent products making better application decisions. More specifically, this workshop will take you through the network development flow for sound classification (detecting certain sounds) and vision object detection and walking you through our reference design that has sound and vision sensors sharing meta data that enable a higher level application to leverage certain events it sees and hears.

 

What you will learn:

• What makes the Xilinx MPSoC unique regarding neural network processing at the edge

• How to use Aaware Sonus AI to tune sound classification models (how to retrain models with additional environmental background noise)

• How to use Aaware sound classification models together with Xilinx Model Zoo vision models

• How to access the Aaware sound and Xilinx vision model APIs to build higher level AI based applications at the edge

 

Target markets:

• Security & Surveillance

• Robotics

• Conferencing

• Kiosks

  • community survey
  • Share
  • History
  • More
  • Cancel
  • Sign in to reply

Top Comments

  • aawarejoe
    aawarejoe over 4 years ago +3
    Hello there, My name is Joe Gianelli and I'm the CEO of Aaware Inc. We are in discussion with Avnet about offering a compelling workshop that exposes how the Xilinx MPSoC can be used at the edge to process…
  • 14rhb
    14rhb over 4 years ago +2
    I was thinking how the human body utilises these two senses so well. In amongst even a noisy audio scenario we can often still extract our name being called as a trigger to look around, see a familiar…
  • robogary
    robogary over 4 years ago in reply to aawarejoe +2
    The dog barking example sounds pretty cool. Vision to confirm if its a dog, vicious dog or friendly dog, and if a dog on a leash. loose vicious dog RUN ! :-)
  • robogary
    robogary over 4 years ago in reply to aawarejoe

    The dog barking example sounds pretty cool.  Vision to confirm if its a dog, vicious dog or friendly dog, and if a dog on a leash.

    loose vicious dog RUN !    :-) 

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • aawarejoe
    aawarejoe over 4 years ago

    Hello there,

     

    My name is Joe Gianelli and I'm the CEO of Aaware Inc. We are in discussion with Avnet about offering a compelling workshop that exposes how the Xilinx MPSoC can be used at the edge to process AI sound and vision models, enabling more sophisticated applications. In this workshop we'll walk you through a reference design that can do one of the following:

     

    1. Detect sneeze….then face detect…then detect is person wearing mask or not (using sound+vision to confirm health concern)
    2. Detect dog barking….then vision to confirm dog or not (using sound+vision to confirm correct identity)

     

    Which of these reference designs would be most compelling use case?

    • Cancel
    • Vote Up +3 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • 14rhb
    14rhb over 4 years ago

    I was thinking how the human body utilises these two senses so well.

    • In amongst even a noisy audio scenario we can often still extract our name being called as a trigger to look around, see a familiar face or someone looking at us.
    • Another scenario could be we hear something that sounds dangerous and also alerts us to look around or run - a car skidding, a tree creaking in the wind as it snaps....
    • I hear my refuse lorry coming along, and it cues me to look out a few minutes later to work out where my bin is along the road

     

    In electronics the two systems could also work together to create systems that are more aware of the environment they operate in. To be able to slew a limited field of view camera around in azimuth to where something of interest was heard would be invaluable IMO.

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • More
    • Cancel
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube