element14 Community
element14 Community
    Register Log In
  • Site
  • Search
  • Log In Register
  • Community Hub
    Community Hub
    • What's New on element14
    • Feedback and Support
    • Benefits of Membership
    • Personal Blogs
    • Members Area
    • Achievement Levels
  • Learn
    Learn
    • Ask an Expert
    • eBooks
    • element14 presents
    • Learning Center
    • Tech Spotlight
    • STEM Academy
    • Webinars, Training and Events
    • Learning Groups
  • Technologies
    Technologies
    • 3D Printing
    • FPGA
    • Industrial Automation
    • Internet of Things
    • Power & Energy
    • Sensors
    • Technology Groups
  • Challenges & Projects
    Challenges & Projects
    • Design Challenges
    • element14 presents Projects
    • Project14
    • Arduino Projects
    • Raspberry Pi Projects
    • Project Groups
  • Products
    Products
    • Arduino
    • Avnet & Tria Boards Community
    • Dev Tools
    • Manufacturers
    • Multicomp Pro
    • Product Groups
    • Raspberry Pi
    • RoadTests & Reviews
  • About Us
    About the element14 Community
  • Store
    Store
    • Visit Your Store
    • Choose another store...
      • Europe
      •  Austria (German)
      •  Belgium (Dutch, French)
      •  Bulgaria (Bulgarian)
      •  Czech Republic (Czech)
      •  Denmark (Danish)
      •  Estonia (Estonian)
      •  Finland (Finnish)
      •  France (French)
      •  Germany (German)
      •  Hungary (Hungarian)
      •  Ireland
      •  Israel
      •  Italy (Italian)
      •  Latvia (Latvian)
      •  
      •  Lithuania (Lithuanian)
      •  Netherlands (Dutch)
      •  Norway (Norwegian)
      •  Poland (Polish)
      •  Portugal (Portuguese)
      •  Romania (Romanian)
      •  Russia (Russian)
      •  Slovakia (Slovak)
      •  Slovenia (Slovenian)
      •  Spain (Spanish)
      •  Sweden (Swedish)
      •  Switzerland(German, French)
      •  Turkey (Turkish)
      •  United Kingdom
      • Asia Pacific
      •  Australia
      •  China
      •  Hong Kong
      •  India
      •  Japan
      •  Korea (Korean)
      •  Malaysia
      •  New Zealand
      •  Philippines
      •  Singapore
      •  Taiwan
      •  Thailand (Thai)
      •  Vietnam
      • Americas
      •  Brazil (Portuguese)
      •  Canada
      •  Mexico (Spanish)
      •  United States
      Can't find the country/region you're looking for? Visit our export site or find a local distributor.
  • Translate
  • Profile
  • Settings
RoadTests & Reviews
  • Products
  • More
RoadTests & Reviews
RoadTest Forum A Conversation about RoadTests, Missing Reviews, and the Future
  • Blogs
  • Forum
  • Documents
  • RoadTests
  • Reviews
  • Polls
  • Files
  • Members
  • Sub-Groups
  • More
  • Cancel
  • New
Join RoadTests & Reviews to participate - click to join for free!
Actions
  • Share
  • More
  • Cancel
Forum Thread Details
  • Replies 124 replies
  • Subscribers 2761 subscribers
  • Views 14493 views
  • Users 0 members are here
  • RoadTest
  • scasny2
  • hardware testing
  • road test
Related

A Conversation about RoadTests, Missing Reviews, and the Future

rscasny
rscasny over 9 years ago

Several years ago when I interviewed with Newark element14, I visited element14 website as part of the preparation for my interview. Most recently, I had been a technical writer for an industrial connector company that sold a special kind of "switch-rated" connector used in industrial facilities, oil fields and ocean platforms, mines, generators, wastewater treatment plants, among others for high horsepower, 3-phase induction motors that could interrupt currents at full load and eliminate the risk associated with arc flash accidents. So, element14.com was quite a different kind of company for me! I told the interviewer that I was "wowed" by the depth of content, its variety, and the endless amount of participation of the element14 community members.

 

I thought back then, as I do now, that the RoadTest section of the community was remarkable. The reviews, including vivid images, scope shots, and videos were just so special. Even now, I enjoy reading through them; the authors of RoadTest reviews exhibit a passion for their subject and a depth of knowledge that is unmatched.

 

I didn't initially work in the Community when I joined the company. I was assigned to the Video team where I produced product video scripts for our transactional sites, Newark and Farnell. With recent staff changes, I ended up taking over the management of the RoadTest program. It is a lot of work, but it is satisfying when am complimented on the RoadTest area. Of course, these compliments are your compliments-- the community of RoadTesters.

 

There's much more work involved in managing the program than may appear to the casual observer. I interact with suppliers, select products to review, order & ship parts, create the RoadTest pages (with the help of my colleagues tariq.ahmad and pchan).Since I am the main contact for the suppliers who want to participate in the RoadTest program, I hear what's on their minds: their concerns and their problems.

 

On the topic of problems and concerns, last December a supplier contacted me regarding a RoadTest Review he wanted to read; he couldn't find it. I just thought he had problems navigating our huge website so I looked for it myself; I couldn't find it, either.  I contacted the RoadTester regarding the review I could not find several times; I received no response. The supplier contacted the RoadTester as well. (The RoadTester had logged onto the site after being contacted by us.) Ultimately, in frustration, the supplier's National Sales Manager contacted the RoadTester asking for the product to be returned. As a result of this experience, I spent a day auditing the RoadTest Reviews. I stopped when I saw 85 were missing over the last year. I realized then I had a problem that I needed to address.

 

Understanding the Problem of Unwritten Reviews Has Been a Problem for Me

 

Prior to writing this piece, I met with other members of our team to discuss the problem. Was it a problem, really?  I think that's a valid question. After all, our RoadTesters are human beings. You get sick. You have family problems. Your day jobs can overload your time. I guess if I were an official RoadTester and a family problem was preventing me from submitting a review by the deadline, I would send a courtesy email telling me (or Kelly or Diane) of the situation. I rarely receive status updates by the RoadTesters, which I found a bit odd. (When I do, it usually concerns shipping issues.) Maybe is an age thing: I am much older than many of our members. I was in the military, trained to "go the extra mile." Who knows!

 

I think why I am having a difficult time understanding this problem is when I began following up with the RoadTesters. I contacted an official RoadTester about his review, which was due 4 months prior to my message, and he messaged me back with the following: "I don't have the resources to just pick it up now. Sorry." I guess I just got blown off.

 

I contacted another official RoadTester asking for the status of his review. He responded with the following: "Well, first I would like to reaffirm that I WILL BLOG HERE and honor what was asked of me." It's been about 75 days since he received the product and I haven't received the review. I guess he is not someone who stands by his word. I messaged him today that without the review I would have to suspend his participation in the program. He shot me a message and saying that's okay by him. He still has the product and I don't have the review. And I have a supplier to answer to.

 

Another person even blamed me for asking for reviews because I was dissing all RoadTesters (presumably for even asking.) That's not worthy of a response.

 

I guess I am perplexed. After all, a RoadTester is given a free product and in return all I am asking for is a posted review. You don't have to write a book. Just provide your objective opinion.

 

So, how will this problem we solved. Well, let me start with a self-critique.

 

Solving the Problem of Missing RoadTest Reviews

 

I could make excuses and complain about my heavy workload, but that won't solve anything. For starters, I think I could do a better job at communicating with the official RoadTesters. I have communicated, but it has been later in the process; I have to do a better job at communicating earlier. I have enlisted my colleague e14megan, our Community Manager, to help me. We will try harder.  But open communication is a two-way street; I feel I should not have to always initiate communication on the status of your RoadTests.

 

I also feel I have to do a better job about ordering parts earlier in the process. I have been managing the program for a few months and have realized that many of the products being roadtested are new product introductions, which often don't have a lot of inventory; therefore, I have to order them earlier. Moving forward, I will not create any new RoadTests until I have possession of the products.

 

I think I have to do a better job at screening RoadTest applicants. I review all applications and make recommendations before sending the whole package off to the supplier who makes the final decision on official RoadTesters. I think our current RoadTest application form is too general. Therefore, I am in the process of improving the form for better screening of applicants, regarding their qualifications, knowledge and (most importantly) their participation in the element14 Community. People who participate a lot by commenting, writing blogs, and reporting on project builds deserve to RoadTest that $3,000 piece of test equipment.

 

Finally, I have noticed a lot of the applications that do not communicate clearly what they are going to do for a RoadTest. Some applications are so long that I wonder if the project can be accomplished in 60 days. I've pondered this most of all, asking myself what is a RoadTest? This reflection made me list 5 different RoadTest types:

 

  • Unboxing (14 days to complete): I think an unboxing can be a useful way to RoadTest a product despite its apparent simplicity. It surely tests if the product works out of the box and all the parts and documentation are provided. But this type of RoadTest does not require 60 days to complete. I think it can be done in a few hours. For this reason, if a RoadTester chooses to perform this type of RoadTest, he/she will need to post the official review in 14 days from delivery of the product.

 

  • Test a Product Claim (21 days to complete): I think testing a product claim, albeit more limited than an project-type, is another way to RoadTest a product. For example, some manufacturers claim you can get the product up and running in 30 minutes. Well, go ahead and test it! And report what happens. I give this 21 days to complete.

 

  • Testing to a Procedure or Standard (30 days to complete): For some products, companies will provide a detailed procedure for pre-compliance testing. (There are also testing standards by regular orgs; these may be more difficult to replicate the procedure.) In any event, testing a D.C. power Supply to an established Procedure would be an example of this type of RoadTest. Since it requires a bit of research on the RoadTester's part, I give it 30 days to complete.

 

  • Simple Project (45 days to complete): Projects always take a lot more time and creativity to produce. Plus, the review itself is usually longer. A simple project would be something like taking a Raspberry Pi, adding a sensor on the input and a motor/actuator on the output to perform some type of action. I give something like this 45 days to complete.

 

  • Complex Prototype Build (60 days to complete): Complex projects are the pinnacle of RoadTests. They take the product and use it to build a product prototype. This type of RoadTest would be similar to a Design Challenge project. As such, it would require more time and a more involved review. Hence, it merits more time. I give it 60 days to complete; however, I could be swayed to 75 days if it were really something unique.

 

The Solution: Not Only Me But the Community

 

While it is my job to manage the RoadTest program, and offer my ideas, I think the solution will be forged by the community of RoadTesters as a whole. Perhaps some ideas I have offered in this piece, resonate with you-- tell the community why. Perhaps you think I am off base or wrong; that's fine, tell the community why (but anticipate that I will engage you). Perhaps you have another idea; by all means enter it in the comments section below. I will be rolling out some improvements to the RoadTest Program, so stay tuned. Thank you for participating in our Community.

  • Sign in to reply
  • Cancel
  • DAB
    DAB over 9 years ago in reply to kas.lewis

    I agree.

     

    That makes it incumbent on Randall and crew to hit up the vendors for more basic kits to test so that we can prime the pump for more sophisticated road testing.

     

    DAB

    • Cancel
    • Vote Up +5 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 9 years ago in reply to DAB

    DAB

     

    I like the level/badge idea it gets people involved in the community and encourages them to stick around not just pop in for the cool stuff. That being said I would say you might need a broader range of beginner road test. What I mean by this is I would not enter a road test for a BBB or RPi as those are not things that either interest me or are my strong points for review, unless it's how easy it is for a beginner to use. I'm more into the embedded C space or bare metal kits. So as long as there is a slightly wider range for people to get in on the ground floor I think your idea is the best. This idea is also what I have seen implemented on other sites that are very much community based and only want people doing reviews that are part of the community and will do a full review.

     

    Kas

    • Cancel
    • Vote Up +4 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 9 years ago in reply to jc2048

    There are people who do participate quite a bit but are not top members. There are even some people here who blog quite bit on meaningful topics (not regurgitated from other sites) and are not top members.

     

    As for the one day roadtest, I agree on the disappointment. I stayed up late getting my proposal together understanding the part and what made it unique to roadtest. I later found out the deadline was extended and the announcement date was pushed back a good few weeks.

     

    Regarding your last point of making notification as to who is who on here, as a blogger for E14 which really means I get maybe a project a year from E14 (I would love to do more) I am suppose to have a badge on my choose three that identifies me as such. After noticing that most if not all of the other bloggers here don't identify themselves I took my badge down. Maybe a badge could be used for Top Members rather than a gold medal by their name. That way if they want to identify themselves as such they can and its also less "in your face" the top member thing. But knowing who is Full time E14, who are full time bloggers and who are part time would help other have a better understanding what goes on here on E14.

     

    Kas

    • Cancel
    • Vote Up +3 Vote Down
    • Sign in to reply
    • Cancel
  • DAB
    DAB over 9 years ago

    Hi Randall,

     

    Last year I proposed a simple solution called creating trusted road testers.

    You could do it as an extension of your badges.

    Use the inexpensive gear to test new road testers.  Those that comply with the rules, do a good job of posting they get badges of accomplishment.

    For the more expensive gear, only those people of certain badge levels get to apply, thus creating an incentive for newbies to come through on their first road test to actually post.

     

    This way we set up an incentive driven system by which those of "proven" testing capability get to test the best gear.

     

    I think you will find that your suppliers would be in great favor of this type of reward for demonstrated performance system.

    It would encourage them to let us test some of their better gear.

     

    The small stuff is always available and you can tolerate a fair percentage of take and run types.  But once they see the benefit of fulfilling their commitment, we might be able to bring a more stable road test group into the fold.

     

    DAB

    • Cancel
    • Vote Up +11 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 9 years ago in reply to hlipka

    Returning the product I think is a great idea, the only issue is returning an item can sometimes cost more than the item itself so it can be hard to justify for small cost items. As for dummy reviews of which I have seen some interesting ones "Cool product works nicely..." etc. There should be a word limit. When a blog is needed for other parts of the E14 site there is usually a requirement of 500 - 2000 words minimum, no reason why this could not be implemented here as well. And not meeting the requirement (this could be relaxed if the review is meaningful) would imply an incomplete review and lead to blacklisting.

     

    On the opposite side a overly lengthy review while impressive to some I find a turn off. Looking at 5 pages of long text and tables with pictures only to add color but not to really add value has me moving on to other parts of the site. I don't find these useful or interesting reviews, in these cases a series of blogs would be more relevant and helpful.

     

    Kas

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • Cancel
  • kas.lewis
    kas.lewis over 9 years ago in reply to tomaja

    I don't think limiting to "Top Members" is right or a way to grow the community. I do believe that those who have proven to be reliable is. What I mean is if someone has shown that they can complete reviews in a meaningful way and on time that should be a qualifying factor not the designation of TOP MEMBER (Which in some ways has only worked to close the community not invite more people in). Points should also count as anyone who signs up just for a review or signs up with a new name because they have been blacklisted for previous bad behaviour should not be allowed to participate just for the cool stuff. I also like the idea of having none completed reviews have the product returned or paid for by the offending reviewer. It's not a give away its an exchange of services, a product for a review.

     

    This issue has been commented on a lot but the argument of "inviting new members" has always trumped any meaningful will to fix the issue. I'm happy rscasny has taken a fresh and realistic approach to this issue and looking to get members that want to participate is more important than getting members that want cool stuff and only cool stuff.

     

    Kas

    • Cancel
    • Vote Up +5 Vote Down
    • Sign in to reply
    • Cancel
  • dougw
    dougw over 9 years ago in reply to jc2048

    I like your categories and analysis. I'm one of those members who is not comfortable with the title of Top Member, but I view it as another price of participation. I also don't like all the other areas on the site where you have to sign up or subscribe to participate, but that is off-topic.

    I like the idea of "pick-your-own" although I can't see it being too attractive to manufacturers.

    As far as road testers who don't follow through, maybe one of the road test conditions should be that for any road testers who do not blog within a month, their proposals get published anyway. Perhaps subsequent discussion of such proposals by members would help road testers who have some trepidation or blocks.

    • Cancel
    • Vote Up +3 Vote Down
    • Sign in to reply
    • Cancel
  • tomaja
    tomaja over 9 years ago in reply to rscasny

    Yes, I support that kind of limitation for the most valuable items even though I'm not a top member.

    dougw's idea of assigning 80% of those reviews to proven members seems more than fair. I get disappointed when a new member receives something great for a review and then after a year or two you see that the last activity of that member was asking about delivery... Top members never do that and usually their reviews give more to us readers.

    To get to the top member status and opportunity to do top reviews one should start with smaller tasks and prove he/she deserves more complexed/expensive stuff.

    • Cancel
    • Vote Up +5 Vote Down
    • Sign in to reply
    • Cancel
  • msimon
    msimon over 9 years ago in reply to hlipka

    The idea is good but I think it is hard to achieve an international legally binding contract.

    • Cancel
    • Vote Up +2 Vote Down
    • Sign in to reply
    • Cancel
  • shabaz
    shabaz over 9 years ago in reply to jc2048

    Hi Jon,

     

    The one-day thing was just a quick way in Jive to turn on the system to enable a RoadTest for an individual, the system doesn't allow for a different method as I understand. For example, I'd purchased a crimp tool, and I wanted to review it, so it required the element14 team to enable it in the system, but it does mean it is visible for a short amount of time. It is also for things that are not intended for a normal RoadTest (e.g. things not yet released, for an early review).

    • Cancel
    • Vote Up +4 Vote Down
    • Sign in to reply
    • Cancel
<>
element14 Community

element14 is the first online community specifically for engineers. Connect with your peers and get expert answers to your questions.

  • Members
  • Learn
  • Technologies
  • Challenges & Projects
  • Products
  • Store
  • About Us
  • Feedback & Support
  • FAQs
  • Terms of Use
  • Privacy Policy
  • Legal and Copyright Notices
  • Sitemap
  • Cookies

An Avnet Company © 2026 Premier Farnell Limited. All Rights Reserved.

Premier Farnell Ltd, registered in England and Wales (no 00876412), registered office: Farnell House, Forge Lane, Leeds LS12 2NE.

Follow element14

  • X
  • Facebook
  • linkedin
  • YouTube