element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet & Tria Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • About Us
    About the element14 Community
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Japan
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      •  Vietnam
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Raspberry Pi
  • Products
  • More
Raspberry Pi
Blog Building a Thermal Imaging System with the Raspberry Pi 3, Sense HAT and Panasonic Grid-EYE
  • Blog
  • Forum
  • Documents
  • Quiz
  • Events
  • Polls
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join Raspberry Pi to participate - click to join for free!
Featured Articles
Announcing Pi
Technical Specifications
Raspberry Pi FAQs
Win a Pi
GPIO Pinout
Raspberry Pi Wishlist
Comparison Chart
Quiz
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: shabaz
  • Date Created: 9 Nov 2016 12:09 PM Date Created
  • Views 12793 views
  • Likes 19 likes
  • Comments 63 comments
Related
Recommended
  • thermopile sensor
  • pi 3
  • rpiintermediate
  • panasonic grid eye
  • amg8832ek
  • amg8834ek
  • rpibeginner
  • amg8834
  • thermopile
  • amg8832
  • infrared_sensor
  • panasonic grid-eye
  • grid eye
  • thermopile array
  • grid-eye sensor
  • rasberry pi 3
  • javascript
  • panasonic_industrial_europe
  • infrared array
  • node.js
  • pi3-ibm-iot-learnkit
  • grid-eye

Building a Thermal Imaging System with the Raspberry Pi 3, Sense HAT and Panasonic Grid-EYE

shabaz
shabaz
9 Nov 2016

Introduction

Sometimes it is great to be able to see if things are hot or cold with a thermometer or other device. Multiply it by 64 and it is possible to get a graphical image of hot spots or detect humans for instance.

A thermopile array can be used to measure temperature from a distance and a special part from Panasonic called Grid-EYE happens to have 64 of them : )

Since the Sense HAT has 64 LEDs, I wanted to try them together : )

image

 

This is what is implemented:

image

 

For more experiments with the Grid-EYE and a review, see here: Panasonic Grid-EYE RoadTest - Review

 

What can you do with it?

The Grid-EYE is designed for detecting humans or objects that come into its field of view. It could be used for automatically turning on the heating when a human is detected, or automatically opening doors for instance. It differs greatly from the usual passive infrared (PIR) sensors used in alarm systems; they require movement whereas thermopile sensors will continuously detect objects while they remain in the field of view. By processing the images over time it is possible to see which direction humans or objects are moving. This could be useful for more intelligent automated doors or barriers, or for innovative electronic advertising that is triggered by human presence and actions.

 

In the brief time that I explored, it was possible to see people from a distance of five metres, and a 10 ohm resistor connected to an AA battery from about an inch away. By experimenting with the software it is possible to choose the spectrum of color that is desired for the particular temperature range of interest.

image

 

Grid-EYE usefulness for people detection (occupancy sensor) was explored in the Grid-EYE Review blog post.

 

Build Steps

The project is straightforward and simple, so in the interests of efficiency this report won’t have a lot of text!

To build this project, a Pi 3 and a Sense HAT is needed, and the Grid-Eye evaluation kit. I already had the Pi 3 and Sense HAT (and the associated memory card and power supply) as part of the Pi 3 IBM IoT Learner KitPi 3 IBM IoT Learner Kit reviewed here. The Grid-EYE evaluation board is available separately. The one I had (model AMG8832) is not available any more but there is a better performance AMG8834 Grid-EYE Evaluation ModuleAMG8834 Grid-EYE Evaluation Module that can detect humans up to 7 metres away.

 

The evaluation board contains the Grid-EYE, a pre-programmed microcontroller and Bluetooth Smart capability. Basically nothing needs to be done with the eval board except plug it into a power supply! The supply can be a 5V mobile phone charger or a PC USB port. The photo here shows the Grid-EYE evaluation board. It is about the footprint of a playing card. The Grid-EYE module itself is very small, about 12mm on its longest dimension.

image

 

Since the Pi 3 also has Bluetooth Smart capability, the Grid-EYE board connects to the Pi using this. This is great because it means that the imaging can be performed remotely.

The Pi 3 is responsible for translating the 8x8 array of values into colours and sending them to the Sense HAT’s display. The Pi 3 also runs a little web server so any web browser (e.g. PC or mobile phone) can be used to connect to the Pi and view the images live.

Check out the short video (1.5 mins) for some example capture.

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

 

 

Here are the instructions to build it. First, as root user (or prepend sudo to these commands):

 

apt-get install libbluetooth-dev
update-nodejs-and-nodered

 

Then, as normal user (e.g. pi or your username):

 

git clone https://github.com/shabaz123/grid-eye
cd grid-eye
npm install noble
npm install sense-hat-led
npm install rotate-matrix
npm install ioctl
npm install socket.io
npm install imagejs

 

Change the index.js file at grid-eye/node_modules/sense-hat-led using the index.js_mine file (which has been through the babel transpiler) using this command:

 

 

cp index.js_mine node_modules/sense-hat-led/index.js

 

 

The grid-eye/index.js file will need a modification, search for the line with the text progpath and set it to point to the grid-eye folder. The slash at the end is important. For example for me it says:

 

var progpath='/home/shabaz/grid-eye/';

 

That’s it! To run it, as root user (or prepend with sudo) type:

 

node index.js

 

Use a browser to navigate to http://xx.xx.xx.xx:8081/index.html

The code works but is just prototype quality and there is lots of room for improvement. It seems to work reasonably well but would benefit from some configuration options (things like temperature range are hard-coded).

Attachments:
index_pc.zip
  • Sign in to reply

Top Comments

  • ajens23
    ajens23 over 9 years ago +5
    Now that is pretty cool! (errr....hot,,,, or something like that) I'm going to have to try that.
  • DAB
    DAB over 9 years ago +5
    Excellent post. I knew that the Grideye sensor had great capability, so it was great to see that it could be as useful as I thought. Now all I need to do is find some time to play with one. DAB
  • beacon_dave
    beacon_dave over 9 years ago +5
    I have been pondering over how well these Grid-EYE sensors might work for room occupancy monitoring purposes. For example if they were mounted on a ceiling over a seating bank, then could they identify…
  • shabaz
    shabaz over 8 years ago in reply to maanas.adi

    I see.. mine as AMG8832, so there could be a slight difference in sensitivity causing this.

    Anyway, you are almost there. The display is not flat green, there are shades, so you are reading values. Just the scaling is perhaps different, or your grid-EYE is in a very hot environment.

    What happens if you point Grid-EYE at an ice-cube or something cold?

    The conversion from temperature to a value that is ultimately changed into a color (green in your case) is in the function temp2pixel, in the index.js file.

    You can see the line:

    rgb=colorlib.single2rgb24((cval-19)*1700);

    It is very basic code, and the values are hard-coded here, so you may wish to change them to suit your environment, or make it auto-adapting.

    The value 19 is chosen to be a few degrees below ambient room temperature. I remove that offset. Then, I multiplied by 1700 which was just trial-and-error, until I got enough color changes to detect hands, and other warm objects.

    So, if your room temperature is (say) 25 degrees C, then change the value 19 to (say) 21 or 22, and see what happens. It should shift everything down so that the color is not green, but a darker color. Then test putting a hot object in the view of Grid-EYE and so on.

    You may need to tweak the 1700 value too, to (say) 1200 etc. But try changing the value 19 first, to something a few degrees higher.

    I did no boundary checks, so if you use a value that is too high, you may see strange color changes too. My code is very basic, so expect to tweak the values to get a nice display.

    A better solution would be to detect the min/max temperatures across all 64 pixels, and perhaps filter the min and max values over many frames, and dynamically change the temp2pixel formula, so that if Grid-EYE is moved from a very hot to a very cold environment, then the colors on the display eventually automatically scale. That's just an idea, or another approach could be to have these settings adjustable on the browser page.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • maanas.adi
    maanas.adi over 8 years ago in reply to shabaz

    Sorry for the mistake. Yes, it is a square(I was too happy ). Mine is AMG8834 evaluation board. I saw the data being sent in doimage function. It is mainly Green.

     

    image

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • shabaz
    shabaz over 8 years ago in reply to maanas.adi

    Great, glad that part is functioning. Could you show a photo or describe what you're seeing?

    There should be a square box (not a rectangle) framed in blue like in the screenshot below. Is the entire square box all green inside? Is it one shade of green, or varying?

    Green is something quite hot. In the screenshot below, the green is from two candles, 50cm away from Grid-EYE. The orange above it is from a home heater, about 4m away from it.

    But if you are seeing a flat green (no different shades of green) then there may be some other issue. You may need to add debug in the index.js file, to see what values are being sent. For example, if you are using a different model of Grid-EYE, perhaps the scaling is different (this is a guess).

     

    image

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • maanas.adi
    maanas.adi over 8 years ago in reply to shabaz

    Thanks. Now its working.

    There is a small rectangle that has appeared in the web browser with fully green colour.

    Do I have to change the code somewhere to see a somewhat blurred image because as if now it is not showing even the blurred images as I saw in your earlier comments.

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • More
    • Cancel
  • shabaz
    shabaz over 8 years ago in reply to maanas.adi

    To be clear, this is the file that you need:

    http://ajax.googleapis.com/ajax/libs/jquery/1.6.2/jquery.min.js

    If you place it in the same development/grid-eye folder, then you can change the part in index.html (on line 5) that says

    src="http://ajax.googleapis.com/ajax/libs/jquery/1.6.2/jquery.min.js"

    to

     

    src="jquery.min.js"

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • More
    • Cancel
<>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2026 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube