element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
Robotics
  • Technologies
  • More
Robotics
Blog Paralyzed man controls a robotic arm with high precision, via thought
  • Blog
  • Forum
  • Documents
  • Quiz
  • Events
  • Polls
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join Robotics to participate - click to join for free!
  • Share
  • More
  • Cancel
Group Actions
  • Group RSS
  • More
  • Cancel
Engagement
  • Author Author: Eavesdropper
  • Date Created: 18 Oct 2011 9:29 PM Date Created
  • Views 540 views
  • Likes 0 likes
  • Comments 0 comments
  • research
  • industrial
  • hmi
  • robotics
  • robots
  • control
  • telepresence
  • robot
  • on_campus
  • behavior
  • eavesdropper
  • school
  • Health
  • university
  • medical
  • sensor
  • innovation
Related
Recommended

Paralyzed man controls a robotic arm with high precision, via thought

Eavesdropper
Eavesdropper
18 Oct 2011

You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

 

 
Sometimes we cannot even spare 5 minutes to read an article, let alone 10 to watch a video.
Here is the article's highlight:
● Tim Hemmes, a paralyzed volunteer, was able to move a robotic arm via electrodes directly connected to his brain.
● Researchers in the project plan on piecing the brain to get a better reading, and using multiple sensors.
● The study was conducted at the University of Pittsburgh School of Medicine and the UPMC Rehabilitation Institute.
For those who do have time, continue below:
 
 
“I put my heart and soul into everything they asked me to do. I got to reach out and touch somebody for the first time in seven years.” - Tim Hemmes, who was paralyzed after a motorcycle accident.
 
Tim Hemmes was part of a ground-breaking  experiment at the University of Pittsburgh School of Medicine and the UPMC Rehabilitation Institute. The researchers applied an electrocortigraphy (ECoG) grid of electrodes directly on a section of Hemmes brain. Through the use of thought, Hemmes could  move a robotic arm and high-five his girlfriend. (See the heartwarming video above.)
 
On August 25th, UPMC neurosurgeon Elizibeth Tyler-Kabara placed the grid on his brain in about 2 hours. She explained the operation, "Before the procedure, we conducted several functional imaging tests to determine where his brain processed signals for moving his right arm. We removed a small piece of his skull and opened the thick layer of protective dura mater beneath it to place the grid over that area of motor cortex. We then put the dura and skull back with the wires on the outside of the skull but under the scalp.” Dr. Tyler-Kabara routed all the ECoG wires down to exit through Hemmes chest for connection to the various computers.
 
For 6 days a week, over the course of 4 weeks, Hemmes was tested and monitored. The first tests were for Hemmes to navigate and move virtual objects. After some time of watching a virtual avatar move an arm, he learned what he needed to think of to move everything properly. After a short time, he  move virtual objects around the screen fairly accurately. However, it was not a "think of your arm moving, and it will move its arm" type of control. Instead, he would think of his thumb moving, that would signify move left, and move an elbow is meant for move right.   
 
Assistant professor and co-principal investigator Wei Wang explained, "He mentally associated specific motor imageries with desired movement direction. It required concentration and patience, but this process seemed to get easier for him with practice, just like when someone learns to drive a car with a manual transmission. In future studies, we also will test other approaches, including the participant simply thinking up for up, down for down, and so on.”
 
After eight sessions, Hemmes was able to move the ball in three dimensions on a 3D television. This movement technique was applied to a robotic arm built by John Hopkins University Applied Physics Laboratory. The rest is explained in the following video.
 
You don't have permission to edit metadata of this video.
Edit media
x
image
Upload Preview
image

 
 
The next step for the research team is a 10-by-10 array of electrode points that pierce the brain and seek to monitor 100 different neurons (points go in about 0.1" ~2.54mm). This device will attempt to monitor the area of the brain that is responsible for hand movement. Co-principal investigator, Professor Andrew Schwartz explained the goal, "We anticipate that these penetrating grids can pick up very clear signals from the brain to reveal what motion is intended by the participant. The second grid will allow us to see what might be possible in controlling the fine movement of the fingers and hand, which is far more complicated but also could offer more useful function for the participant.”
 
The penetrating grid is already showing good results in live monkey testing. One monkey was able to move a robotic arm to grab and feed itself a marshmallow treat.
 
Furthermore, the team plans to investigate the use of sensors, possible on the robotic arm, to send feedback to the operator's brain. They also plan on exploring a way to bypass failed injuries to stimulate the muscle fibers in hand and arms. They are not the only ones with this idea.
 
Unfortunately, Tim Hemmes had the device removed from the skull after the 30-day trial. Whether he will be part of phase two or not is unsure. I will be sure to follow this research.
 
Eavesdropper
 
There are many new developments in electroencephalography (EEG), the recording of electrical activity of the brain.
Read about more EEG tech below:
The paralyzed walk, virtually, with a brain-computer interface
Mindflex mod lets brainwaves make music
Mind-controlled cat ears for everyone
Brain driven car
Tattoo electronics and possibility
There is an app for that? The EEG smartphone application
Bolt in the head reads neural signals
  • Sign in to reply
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube