element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet & Tria Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • About Us
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
RoadTests & Reviews
  • Products
  • More
RoadTests & Reviews
RoadTest Forum Please Read: An Important RoadTest Program Change
  • Blogs
  • RoadTest Forum
  • Documents
  • RoadTests
  • Reviews
  • Polls
  • Files
  • Members
  • Mentions
  • Sub-Groups
  • Tags
  • More
  • Cancel
  • New
Join RoadTests & Reviews to participate - click to join for free!
Actions
  • Share
  • More
  • Cancel
Forum Thread Details
  • Replies 91 replies
  • Subscribers 2566 subscribers
  • Views 6784 views
  • Users 0 members are here
Related

Please Read: An Important RoadTest Program Change

rscasny
rscasny over 8 years ago

This is the third virtual "fireside chat" that I'm writing regarding the RoadTest Program. For this one, I'd like to roll out a RoadTest Program change and explain why the change is occurring.

 

To start, I'd like to share a snippet of an email I received yesterday from a vendor who participates in the RoadTest Program:

 

"We received only 13% reviews back from the RoadTests we sponsored in 2016. I would like to know the status of each of these roadtests. Are the missing reviews still being pursued? I would also like to know if the members that failed to post a review are now being flagged so we do not chose them again."

 

It was not pleasant to respond to. I had to eat "humble pie," as we say in the US, when I responded to this vendor.

 

To solve the problem, I decided I don't want to go down the road of suspending members from the RoadTest program. Suspensions sound too much like the hard rules of the military. I was in the Navy for 10 years and I didn't like tough rules back then, but I knew they were necessary given the reality of uncomfortable shipboard conditions and potentially dangerous operations we were participating in.

 

But this is a community. It should be a place to have some fun, meet new people, network professionally, be a mentor, or get mentored. Suspending people just is the wrong road to follow.

 

The way I've chosen to resolve the problem is the program change.

 

RoadTest application reports will soon include whether a specific applicant has completed all of his/her previous RoadTest reviews. I'm told by our developers this is very easy to do. We will provide this information to the vendor with a RoadTester's application. The supplier will make the decision where to select the RoadTester or not. Given the above comment by the supplier, I think the answer is self-evident.

 

Now, this change will probably cause me more work. If someone were flagged, I will have to check to see if that person is on a current RoadTest and it's before the due date of the official review. I surely don't want to penalize a conscientious RoadTester. I will also have to ensure there are not any extenuating circumstances that have caused the person not to write the review, i.e., sickness, family issues.

 

I am ambivalent about this whole thing. There are many RoadTesters who are doing a fantastic job. But a 13% success rate is not successful. I really have no choice but to implement this change.

 

Sincerely,

 

Randall Scasny

RoadTest Program Manager

  • Sign in to reply
  • Cancel

Top Replies

  • rachaelp
    rachaelp over 8 years ago +10
    Randall Scasny wrote: To solve the problem, I decided I don't want to go down the road of suspending members from the RoadTest program. Suspensions sound too much like the hard rules of the military. I…
  • rscasny
    rscasny over 8 years ago in reply to reinouddelange +10
    Reinoud, I'm glad you posted this. I think it is helpful to take a step back and ask, What is a RoadTest? It's surely not a design challenge. A roadtest is a product review. We give you a product, you…
  • rscasny
    rscasny over 8 years ago in reply to gregoryfenton +8
    Greg, Thanks for the feedback. My only intent of asking this question was to get a sense of an applicant's time availability. I had gotten some messages indicating that they did not complete the road test…
  • rachaelp
    rachaelp over 8 years ago in reply to rscasny

    Randall Scasny wrote:

     

    It's a large sample I didn't want to spell it out because the actual numbers are dreadful. Simplifying it to a percentage is bad enough. But things are improving immensely. People are getting their reviews in or notifying about upcoming review postings, which was not happening 2 weeks ago. Thanks.

    I'm glad people are starting to get their reviews back to you, this is great news image

    • Cancel
    • Vote Up +5 Vote Down
    • Sign in to reply
    • Cancel
  • bbolo1
    bbolo1 over 8 years ago in reply to rscasny

    What about those that didn't reacted so far? Can you send them a private message asking for any update on their side? If they don't bother to reply, then I guess they can be flagged ...

    • Cancel
    • Vote Up 0 Vote Down
    • Sign in to reply
    • Cancel
  • sarunaszx
    sarunaszx over 8 years ago

    I thought that this is already being applied. I think this improvement is neccessary, and might work out fine. 13% review rate is totally unnacceptable.

     

    Also, I believe many Roadtests have applicants that are new and have no roadtest's posted before. Maybe Roadtests should include only a certain percentage of "new" members, so there are more chances of satisfied supplier?

     

    However, I tend to disagree with these short deadlines (2 weeks for unboxing for example). Roadtester's are chosen ~1month after applications are closed. Then there is shipping and etc. The time when you should reserve time for a roadtest is distant and undetermined. I simply cannot plan so much ahead and sometimes it is difficult to find spare 3 hours of free time (having a fresh head of course) to experiment / write even an unboxing review. 60 days seems reasonable to me and should be enough  for everyone to write a review (if no serious issues occur).

     

    From my perspective, RoadTest rules should encourage everyone to participate, not only the ones with the most experience / good testing equipment. That means, letting the applicant know, that the rules are strict, and he has to do the RoadTest in time, although the RoadTest itself does not have to be a masterpiece. The review from "amateurs" side can also be as insightful as from an "expert". It should be clear that the reviewer has spent time playing around, working, trying to integrate the product somewhere, but also spent some time writing the review in a clear and understandable way. For those, who are not sure how to make a roadtest, it would be good to know, what properties of the product the supplier wants to get tested / reviewed? Maybe some template could be created?

     

    Anyway, I think the changes are for the good. If we could increase the review rate, then we could expect more and better products to be supplied for testing image

    • Cancel
    • Vote Up +4 Vote Down
    • Sign in to reply
    • Cancel
  • Former Member
    Former Member over 8 years ago

    I wonder how many people apply for a roadtest and find themselves "out of their depth" when the product arrives? Sometimes I wonder if this is part of the reason many people aren't able to complete their review.

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • Cancel
  • mcb1
    mcb1 over 8 years ago in reply to Former Member

    find themselves "out of their depth" when the product arrives

    That makes the assumption they simply apply for everything in the hope of getting something.

     

     

    Personally I have a look at the item and decide if it is within my capabilities to evaluate it BEFORE applying.

    Once the testers have been announced there is at least two weeks (assuming no delays) to download and copy links for every document available to help you.

    You may also grab some piccys, and sort out software you'll need.

     

     

    So in reality there is more than 2 months available

     

    Mark

    • Cancel
    • Vote Up +1 Vote Down
    • Sign in to reply
    • Cancel
  • Former Member
    Former Member over 8 years ago in reply to mcb1

    mcb1 wrote:

     

    That makes the assumption they simply apply for everything in the hope of getting something.

     

     

    Exactly, either that or just the thought of getting free stuff overshadows the fact that they've got to be able to demonstrate using it. Most of us who do contribute to roadtesting have an interest in the products but some people really are just out to get freebies. There may also be people who have dabbled a bit in electronics thinking they'll be able to just pick up how to use the product as they go along, starting with good intentions but realizing its not as easy as they thought it would be.

     

    Thats not to mention the Raspberry Pi craze, there was so much attention on it being the next big gadget that techies everywhere wanted one, techies in this sense people who are into gadgets (gadget show watchers etc..) and the latest crazes, lots of these people bought Raspberry Pi's but didn't have the technical knowledge to use them so they ended up been put to the back of a shelf, I imagine people like this seeing the chance of getting one for free and jump at it. It still doesn't mean they can use it when it finally arrives.

     

    Sorry if this seems negative but I'd prefer to think of people trying to fulfill their side of the bargain and getting out of their depth then those just taking a freebie and running with no conscience in doing so.

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • Cancel
  • mcb1
    mcb1 over 8 years ago

    Interstingly looking through ACTIVITY I noted 8 people signed up for Road Test.

     

    Mostly all were new to the site, but one enterprising fellow had managed to amass 1325 points in a single day.

    He'd started one conversation and a mention then completed the Plugged in badge.

     

    This made him Level3 which I guess means that he looks like he belongs and has been around.

     

    https://www.element14.com/community/news?streamSource=publication&streamID=821733

     

     

    I don't know if these people all apply, but if Randall is having to sort through these types of issues, then a level based application process is not going to work.

     

    Mark

    • Cancel
    • Vote Up +4 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 8 years ago in reply to mcb1

    It just keeps getting more interesting, what happened to honesty and integrity otherwise known as being a decent human being ?

     

    K

    • Cancel
    • Vote Up +1 Vote Down
    • Sign in to reply
    • Cancel
  • mcb1
    mcb1 over 8 years ago in reply to kas.lewis

    Why wouldn't you apply.

    here is the banner.

    image

    • Cancel
    • Vote Up +3 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 8 years ago in reply to mcb1

    I had mentioned that in another thread (A Conversation about RoadTests, Missing Reviews, and the Future). I agree its an issue when you are trying to stop entrants thinking its free giveaways and then you post its for free...

     

    Kas

    • Cancel
    • Vote Up +1 Vote Down
    • Sign in to reply
    • Cancel
<>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2025 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

ICP 备案号 10220084.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube