element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet & Tria Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • About Us
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
PiCasso Design Challenge
  • Challenges & Projects
  • Design Challenges
  • PiCasso Design Challenge
  • More
  • Cancel
PiCasso Design Challenge
Blog PiCassoTizer - Finger Detection Image Processing - Blog 3
  • Blog
  • Forum
  • Documents
  • Polls
  • Files
  • Events
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: dougw
  • Date Created: 25 Apr 2019 3:56 AM Date Created
  • Views 792 views
  • Likes 10 likes
  • Comments 3 comments
  • image processing
  • doug wong
  • picassotizer
  • picasso design challenge
  • finger recognition
Related
Recommended

PiCassoTizer - Finger Detection Image Processing - Blog 3

dougw
dougw
25 Apr 2019

This project has gotten off to a very slow, very rocky start, but it  is still alive - barely. There are still some key parts on order, but I have been able to get some image processing sorted out.

Here is  a little description of how the big screen touch digitizer will work:

image

This diagram shows an outer frame that holds a camera in each top corner.

The picture in the middle is a big screen TV driven by a Raspberry Pi.

The field of view of the left camera is the yellow translucent area.

The field of view of the right camera is the green translucent area.

The point where the red and blue lines meet is an example of where a finger might get detected by both cameras.

The left camera detection system will only be able to indicate the alpha (a) angle to the finger.

The right camera detection system will only be able to indicate the beta (b) angle to the finger.

Knowing alpha and beta and the distance between cameras (r) allows dr and dl to be calculated.

Which in turn allows calculation of x and y, so we know where on the Pi display the finger is.

To obtain alpha and beta we only need to look at one line of pixels in each camera's field of view.

The following video demonstrates how this can be done with a camera and a Raspberry Pi:

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

The location of the finger is actually just an angle from one side of the camera to the other.

This angular information from each camera will be sent to another computer to figure out the x-y position of the finger.

I don't have 2 cameras yet, but I can start building the camera frame and the computer that will compute finger location.

 

 

Relevant links:

PiCasso Design Challenge

 

PiCassoTizer - Introduction - blog 1

PiCassoTizer - Electronic Parts - Blog 2

  • Sign in to reply

Top Comments

  • shabaz
    shabaz over 6 years ago +3
    Hi Doug, Great project and progress! That does look like very effective tracking. At some exhibition they had a large drawing system, but they took the approach of having a fabric screen and projector…
  • balearicdynamics
    balearicdynamics over 6 years ago in reply to shabaz +2
    Shabaz, it's true (and usually the camera is present, as well as some laser technology as an alternative. Take a look to the link below, it's a street installation of a friend developing this kind of great…
  • genebren
    genebren over 6 years ago +1
    Doug, That is looking pretty cool. The frame rate appears to be quite sufficient and responsive. Good luck on your future updates/progress. (I fully understand struggles of keeping a project on track and…
Parents
  • shabaz
    shabaz over 6 years ago

    Hi Doug,

     

    Great project and progress! That does look like very effective tracking.

    At some exhibition they had a large drawing system, but they took the approach of having a fabric screen and projector, and I suspect a camera behind the fabric, but I can't be sure. The disadvantage of their method is that it took up a lot of space. I'll try to find a video recording of it if I can, in case it gives you ideas (not that you need any! This is a very cool project).

    • Cancel
    • Vote Up +3 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • balearicdynamics
    balearicdynamics over 6 years ago in reply to shabaz

    Shabaz, it's true (and usually the camera is present, as well as some laser technology as an alternative. Take a look to the link below, it's a street installation of a friend developing this kind of great and wide scenarios. Sometimes it's just the size that matters and as far as I know (I never had the possibility to make a kind of installation like this) is just the main goal and the biggest issue image

     

    https://www.orfware.com/portfolio/ermenegildo-zegna-showcase/?fbclid=IwAR0czmdhWyMEKUt5oH3iAeK0qfb-_NkSwx0f0mooysPkowN4Y…

     

    Enrico

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • More
    • Cancel
Comment
  • balearicdynamics
    balearicdynamics over 6 years ago in reply to shabaz

    Shabaz, it's true (and usually the camera is present, as well as some laser technology as an alternative. Take a look to the link below, it's a street installation of a friend developing this kind of great and wide scenarios. Sometimes it's just the size that matters and as far as I know (I never had the possibility to make a kind of installation like this) is just the main goal and the biggest issue image

     

    https://www.orfware.com/portfolio/ermenegildo-zegna-showcase/?fbclid=IwAR0czmdhWyMEKUt5oH3iAeK0qfb-_NkSwx0f0mooysPkowN4Y…

     

    Enrico

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • More
    • Cancel
Children
No Data
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube