element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Personal Blogs
  • Community Hub
  • More
Personal Blogs
Legacy Personal Blogs Human Interaction Robot Based on the Satellite Kit Platform
  • Blog
  • Documents
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: jarain_78
  • Date Created: 18 Jul 2019 11:41 AM Date Created
  • Views 662 views
  • Likes 2 likes
  • Comments 1 comment
  • assistant
  • raspberry_pi_3b+
  • speech-recognition
  • arduino
  • assistant robot
Related
Recommended

Human Interaction Robot Based on the Satellite Kit Platform

jarain_78
jarain_78
18 Jul 2019

In recent years there has been a growing interest in voice assistants. Large companies such as Amazon, Google, Microsoft and Apple, have presented their devices. These allow us to control objects in our home (lights, TV, etc.), using voice commands. At the same time, these devices allow us to access news, listen to music, access our appointment calendar, etc. However, one of the problems these applications have is the ability to develop new applications. With Alexa it is possible to quickly make applications or skills, however, when wanting to connect these applications with our developments is very complicated. The advantage of this device is that being open-source is much easier to connect to our projects and thus increase our applications. The assistant robots represent one of the best elements to accompany elderly people and it is very important that these robots have image and voice recognition systems.

 

 

 

The introduction of a voice recognition system as is the case with Snips (Figure 1), is that it facilitates the form of interaction between the human and the robot. This way we achieve a natural interaction, since Snips recognizes and executes the orders provided by the human. This way the human can ask for the state of the weather, news or order it to move.

 

 

image.png

Figure 1, Snips Developer System

 


 

But before starting with the construction of the robot and the incorporation of Snips as a voice interaction system, it was necessary to perform some previous configuration steps (https://docs.snips.ai/getting-started/quick-start-raspberry-pi). Here are some images and videos.

 

 

 

 

 

20190312_142435.jpg

Figure 2, Snips Unboxing

 

 

 

 

    
You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

 

Video 1, Test Snips

 


 

 

In order for the robot to perform this type of action, it is necessary for it to have a series of elements that allow it to move around, recognize objects, identify people, etc. This is why Snips-Robot has 2 DC motors, a camera and a structure made of aluminium as shown in Figure 3.

 

 

 

 

Captura de pantalla 2019-04-19 a las 11.45.59.png

Figure 3, Snips Robot

 

 

In order for the Snip to control the robot, a Skill was controlled which was divided into three intents (Figure 4).

 

image.png

 

Figure 4, Intents develop to interact with the robot

 

 

 

 


 

Within each of these intents a slot series was created, which allows the user to interact with the robot through Snips. Some of the slots designed so that the user can intellectually interact with the robot, these slots are described below (Figure 5, 6, 7).

 

 

 

 

image.png

 

Figure 5, Intents and Slot “snips_robot_interaction”

 

 

 

image.png

 

Figure 6, Intents and slots “snips_robot_meteo”

 

 

 

 

image.png

 

Figure 7, Intents and Slots “controlling_snips_robot”

 

 

 

In order for these slots to interact with the Snips and robot peripherals, a series of MQTT clients were developed. These clients are integrated into the Snips platform, creating a specific "chat room" to control and acquire data from the different sensors (internal or by BLE). A series of topics were created to control the robot ("actuator/motors", "sensors/ultra_sound_sensors", "sensors/encoder", "sensors/adc") and another topic to access the Rapid IoT device ("sensors/environment") (Figure 8).

 

 

 

 

image.png

 

Figure 8, Topics to integrate robot control and sensor in Snips Central

 

 

 

 

Rapid IoT

 

 

One of the main ideas of this robot, is the ability to be interconnected with other IoT devices. that is why it was decided to incorporate the Rapid IoT system presented by NXP in the previous contest. This device incorporates sensors of air quality, CO2 levels, accelerometers, light level sensors, among others. Snips-Robot can access the information provided by this device and communicate it to the user, allowing to create alarms that inform if the air quality is good or if CO2 levels exceed the permitted ranges. At the same time, the user can request that Snips-Robot, report on these levels. 

 

 

Note: This project incorporates a Rapid IoT system, which was used in the contest: https://www.hackster.io/jarain78/smart-wear-for-application-in-internet-of-medical-thing-iom-a4ec76

 

 

 

 

 

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

 

Video 2, Testing Snips-Robot
  • Sign in to reply

Top Comments

  • dubbie
    dubbie over 5 years ago +1
    I like it! An interesting structure for a mobile robot - it is very tall so it must have a high centre of gravity but it looks fairly stable. Something to try out I think. Also, the first time I saw Snips…
  • dubbie
    dubbie over 5 years ago

    I like it! An interesting structure for a mobile robot - it is very tall so it must have a high centre of gravity but it looks fairly stable. Something to try out I think. Also, the first time I saw Snips I didn't have a Raspberry Pi, now I do so I  might have another look at this technology - seems fun.

     

    Dubbie

    • Cancel
    • Vote Up +1 Vote Down
    • Sign in to reply
    • More
    • Cancel
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube