element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Members
    Members
    • Benefits of Membership
    • Achievement Levels
    • Members Area
    • Personal Blogs
    • Feedback and Support
    • What's New on element14
  • Learn
    Learn
    • Learning Center
    • eBooks
    • STEM Academy
    • Webinars, Training and Events
    • More
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • More
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • More
  • Products
    Products
    • Arduino
    • Dev Tools
    • Manufacturers
    • Raspberry Pi
    • RoadTests & Reviews
    • Avnet Boards Community
    • More
  • Store
    Store
    • Visit Your Store
    • Choose Another Store
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
Project Videos
  • Challenges & Projects
  • element14 presents
  • Project Videos
  • More
  • Cancel
Project Videos
Documents Episode 536: Interactive Light-Up Window with Pose Detection using a Raspberry Pi and Micro:bit
  • Blog
  • Forum
  • Documents
  • Events
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Project Videos requires membership for participation - click to join
Actions
  • Share
  • More
  • Cancel
Engagement
  • Author Author: kellyhensen
  • Date Created: 2 Feb 2022 1:52 PM Date Created
  • Last Updated Last Updated: 23 Feb 2022 6:03 PM
  • Views 10601 views
  • Likes 7 likes
  • Comments 16 comments
Related
Recommended

Episode 536: Interactive Light-Up Window with Pose Detection using a Raspberry Pi and Micro:bit

You don't have permission to edit metadata of this video.
Edit media
x
Upload Preview

Snow and really wet weather ruined Lorraine’s capacitive touch buttons on her last element14 video. This time she was determined to find multiple weatherproof solutions to allow her neighbors to control RGB lights in her sitting-room window. Lorraine built a motion distance sensor using a time of flight sensor and a micro:bit. The neighbors can now control the color of the lights by moving their hands back and forward in front of the sensor. Then, using a Raspberry Pi and an infrared camera, Lorraine tracked whole body movement using pose detection. Raising the right hand changes the lights to red, raising the left hand changes to lights to blue.

What other moves or actions would you add?

 

Supplemental Content:

  • Episode 536:  Bonus Video - Pose Detection Code
  • Episode 536: Bonus Video: Pose Detection Road Blocks
  • Makecode
  • Time of flight sensor library
  • Pose Estimation Library
  • Resources
  • Episode 527:  Interactive Light Up Window using a Raspberry Pi and Micro:bit
  • Episode 527: Bonus Video: Digital Window

Bill of Material:

Product Name Manufacturer Quantity Buy Kit
RASPBERRY PI 4 Raspberry Pi 1 Buy Now
Raspberry Pi Power Supply, USB C Raspberry Pi 1 Buy Now
SD Card TRANSCEND 1 Buy Now
Premium Female/Female Jumper Wires, 40 x 6" Adafruit 1 Buy Now
Raspberry Pi NOIR camera Raspberry Pi 1 Buy Now
VL53L0X time of flight sensor DFROBOT 1 Buy Now

Additional Parts:

Product Name

Infrared lights 

element14 presents

element14 presents  |  About Lorraine |  Project Videos

  • micro:bit
  • time of flight sensor
  • pose detection
  • lorraine
  • e14presents_lorraineunderwood
  • raspberry pi noir camera
  • raspberry pi
  • element14 presents
  • friday_release
  • Share
  • History
  • More
  • Cancel
Anonymous

Top Comments

  • beacon_dave
    beacon_dave 4 months ago in reply to beacon_dave +1

    Perhaps if you created a low resolution LED matrix across the window frame, then you could show the pose as a stick figure. You could then either mimic the captured pose in real time on the matrix or alternatively…

  • beacon_dave
    beacon_dave 4 months ago in reply to beacon_dave

    Need that LED matrix net across the window. Slight smile

    Similar to this, perhaps a 'windshield wipers' gesture (arms parallel moving left to right and back) that results in a rain/snow effect.

    Use a temp sensor, warmer = rain motion, colder = snow motion.

    Fast gesture in rain mode results in some flashes to simulate lightning.

    In snow mode, speed could change the rate that the 'snow' builds up on the window ledge.

    Jumping Jacks could also result in a snow angel type effect. 

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • beacon_dave
    beacon_dave 4 months ago

    "...What other moves or actions would you add?..."

    Perhaps need some sort of rainbow effect here. Move your extended arm in an arc from side to side and a rainbow arc lights up across the window with its tail fading out as you go side to side, cylon style.

    Both arms in an arc moving outwards and you get a solid rainbow from centre to edge, both arms in an arc inwards and the rainbow fades out from edge to centre. 'Jumping Jacks' are optional but might help keep you warm in winter and help burn off a few mince pies...

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • dougw
    dougw 4 months ago in reply to lorrainbow

    I was just responding to the suggestion that reflections could be the problem and indeed it sounds like you are suffering from optical crosstalk. ST has an app note that explains the issues and solutions....

    https://www.st.com/resource/en/application_note/an4907-vl53l0x-ranging-module-cover-window-guidelines-stmicroelectronics.pdf

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • beacon_dave
    beacon_dave 4 months ago in reply to lorrainbow

    Sounds good. LED filament might also work quite well for that, like the animated neon signs.

    Don't forget the sprig of holly though... Blush

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • lorrainbow
    lorrainbow 4 months ago in reply to beacon_dave

    dougw Hmmm I thought in the dark there wouldn't be any natural light reflections? But is it any light you think? 

    beacon_dave Animatronic Santa - on it! I thought of like michelangelo's vitruvian man in LEDs.. and light up the arms/legs that you want them to copy! :D 

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • lorrainbow
    lorrainbow 4 months ago in reply to DAB

    Thanks Dab. Yeah the detail on the camera lets you combine all sorts of combination of body movements.

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • lorrainbow
    lorrainbow 4 months ago in reply to kmikemoo

    oo great ideas with the lens ring. I like recycling broken objects too. 

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • lorrainbow
    lorrainbow 4 months ago in reply to beacon_dave

    oo if it had reached the path I definitely would have created some stickman signs. "Put your hands in the air like you don't care!!"

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • lorrainbow
    lorrainbow 4 months ago in reply to beacon_dave

    Thanks for the link Dave

    • Cancel
    • Up 0 Down
    • Reply
    • More
    • Cancel
  • beacon_dave
    beacon_dave 4 months ago in reply to beacon_dave

    Perhaps if you created a low resolution LED matrix across the window frame, then you could show the pose as a stick figure. You could then either mimic the captured pose in real time on the matrix or alternatively show a suggested pose or gesture for the participant to try and copy. Could do some sort of a Dance Dance Revolution style game with it.

    Not sure what sort of minimum resolution you would need to achieve this  this, probably somewhere around 20x20 I suspect if you want to include steps to the left and right in addition to the basic limb movements. The wired pixel LED daisy-chains might be good for this if you were to turn them into a matrix net by hanging them vertically evenly spaced apart.

    • Cancel
    • Up +1 Down
    • Reply
    • More
    • Cancel
>
Element14

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2022 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • Facebook
  • Twitter
  • linkedin
  • YouTube