Group Actions
Engagement
  • Author Author: zst123
  • Date Created: Date Created
  • Views 735 views
  • Likes 1 like
  • Comments 2 comments
Related
Recommended

Wearable Gesture Control - #1 Introduction

zst123

Table of Contents

Wearable Gesture Control - #1 Introduction

Wearable Gesture Control - #2 Install & Setup Template Application

Wearable Gesture Control - #3 Integrating LCD & Accelerometer

Wearable Gesture Control - #4 Collecting data for Edge Impulse

Wearable Gesture Control - #5 Deploying Edge Impulse model & Fixing Makefile issues

Wearable Gesture Control - #6 BLE communication with an app

Wearable Gesture Control - #7 Low Power Profiling

 

See all my posts here

 

 

Introduction

Firstly, congratulations to all sponsored challengers, I am excited to see what you have with your brand new Infineon kit! I was not too active in the past 2 months and I most definitely missed the application deadline for this contest.

After reading the rules, I realised that any PSoC6 kit can be used for this challenge. I do in fact have an old kit around and it is the PSoC 6 WiFi-BT Pioneer Kit (CY8CKIT-062-WiFi-BT).

Therefore, the purpose of this blog is to introduce my idea as I would like to join as a non-sponsored project.

image

 

 

Idea

My idea is a wearable device to provide gesture control and its intention is to control other gadgets using wrist gestures.

Using BLE, a mobile phone or computer can receive the gestures and perform actions.

 

But note that it is not a unique idea - for example, Android Wear already has gesture control built into their smartwatches, however, their implementations are all closed-source. So I will attempt to build my idea using the PSoC 6 toolkits, and provide open-source documentations.

This is an example of a wrist flick gesture:

image

 

The project shall make use of the following:

- PSoC 6 WiFi-BT Pioneer Kit (CY8CKIT-062-WiFi-BT).

- ModusToolbox IDE

- BLE communication (using AnyCloud examples and the BLE configuration tool)

- CapSense touch sensing

- TFT LCD screen on the CY8CKIT-028-TFT display shield

- Motion sensor on the CY8CKIT-028-TFT display shield

- TinyML for gesture recognition

 

ModusToolbox machine learning enables TinyML for AIoT

I aim to post an update every week, so stay tuned. Thank you for reading and I will catch up with you in the next post!

Parents Comment
  • in reply to DAB

    I plan to create a quick demonstration app to talk to the PSoC. Nothing too fancy and it will do simple actions like go to the next page and display different information based on what it communicates over BLE.

     

    In terms of potential real life applications, perhaps while eating a sandwich and trying to use my phone. My hands will be dirty and I would not want to touch my phone. I can perform a gesture to scroll down on screen. image

Children
No Data