Actions
Forum Thread Details
  • Replies 11 replies
  • Subscribers 2563 subscribers
  • Views 1161 views
  • Users 0 members are here
Related

What is a RoadTest by Invitation?

rscasny

I noticed that there were some comments regarding a new RoadTest I posted, STEM micro:bit - Minode Kit

 

This is a special kind of roadtest. It's called a RoadTest by Invitation. So what does that term mean?

 

Well, the best way to describe it is to talk about this roadtest on the Minode Inventor's Kit. This kit has a microbit and a bunch of electronic parts for building basic projects. It's a product for schools. One of my colleagues had been working with some educators and he suggested offering them these kits so see how well they worked in the classroom, as I understand the situation. So we were looking for a specific kind of roadtester to try out these products. Since we knew whom we wanted to provide the kits to, there was no need for an enrollment period. This is a common use for a RoadTest by Invitation.

 

Other uses for the RoadTest by Invitation would be that the supplier was seeking people with a specific background, or they wanted to get a review in a few weeks instead of 60 days.

 

For some RoadTests by Invitation, the pre-selection process can be more rigorous than a standard RoadTest application. I may contact members I believe are a good fit for a certain type of test, but I may ask them pointed questions about the product as well as their ability to complete the roadtest as per my requirements. And I also consider commitment, participation and professionalism when I recommend a RoadTester by Invitation.

 

I will admit there is one drawback for a RoadTest by Invitation: a first-time roadtester will probably not be selected for it.

 

I personally don't care for RoadTest by Invitations that much. I like the open competition of enrollment. However, I think it is a RoadTest type that is appropriate in some situations.

 

If you have any questions or comments, feel free to put them in the Comments section below. I will monitor this discussion closely for a week. I want to make sure everyone who has questions, get's a personal answer from me.

 

Randall Scasny

RoadTest Program Manager

  •   wrote:

    I personally don't care for RoadTest by Invitations that much

    So I guess you'll only be doing it when specifically requested by the provider of the thing to be tested ... ?

  • in reply to awneil

    Andy,

     

    Yes. I have never initiated on my own a RoadTest by Invitation. It's always been requested by my boss or by the supplier.

     

    Randall

  • Having done a couple of roadtests by invitation, I can see why a vendor would want only a select group of qualified people to test and assess a product or prototype.

     

    I see them as needed only in rare instances and yes, vendor request is indeed a rare instance, but an important part of our relationships with them.

     

    As a member of the community, I can see the value of having a qualified person spend time looking at these types of products, so I see no problem with doing them as long as we get a good road test report.

     

    DAB

  • I think that's similar.
    An invitation would be ideal if this invitation is made face-to-face with a handshake.
    Of course this is not possible with worldwide actions. Therefore, transparency on both sides is very important.
    If you are invited to a RoadTest as an example, then it is important to plan well over the chosen period as well as the necessary preparations.

    It may be that some sub-equipment for the test could be missing in detail.
    Then you can buy this equipment, or you can rent it for the time of the test.
    As an example, "how far do you have to rebuild for the test, so that the test can be made." ....

    The most important thing I see it so that all parties are partners, or should be, no competitors. It should be a teamwork.
    The RoadTester have yes, for example also local "friends", i.e. partners who can support you.

    That's an argue pro for worldwide actions.
    The next thing is, large companies, of which someone is elected, have it easier, as an elected person even smaller companies.

    Then I also see the dynamic behavior of the people who introduce themselves here in the community.
    You should by all means be honest, clear and transparent here, and consider it an honor with responsibility.
    That would be an extra help in estimating the compass of the person who would be invited to the RoadTest; e.g. What is the quality of the pronunciation, the expression of this person?
    So you can read out quality and comes close to the above-mentioned "hand shake".

     

    Best Regards

    Gerald

    ---

  • I have no issues with the concept of the "By Invitation".

    However the clumsy mechanism that Jive provides is not acceptable.

     

    This particular test had a date range, along with the number of kits and even had the enroll button.

     

     

    I suggest that "By Invitations" and not put up on the site, and instead we look for a mechanism to display their findings.

    It could be a blog, or something else that the element14 employees make as official.

     

     

    Cheers

    Mark

  • in reply to mcb1

    the clumsy mechanism that Jive provides is not acceptable

    Is it actually down to Jive itself, or just a mis-application or misconfiguration by E14?

     

    even had the enroll button

    and it actually worked - allowed me to submit an application for an "Invitation-Only" RoadTest!!

     

    image

     

    - please disregard that "application" !!

  • To all Commenters:

     

    I appreciate all your comments. I've been studying RoadTest by Invitations and I am trying to rethink how e14 does them. So everyone's input is being considered.

     

    I think they have value is some situations. Specifically, when a special skill is needed. But the way we produce them to the community should be improved.

     

    My personal preference is to called them Special Roadtests rather than by Invitation and open them up to the community but for a shorter enrollment period. Experienced roadtesters would probably be preferred over first-time roadtesters to do these roadtests.

     

    Special Roadtests would be used in the following situations:

     

    1. a special skill is needed

    2. the roadtest review must be produced in less than 60 days

    3. A pre-launch product: this is when a supplier has the product but the date it is introduced to the marketplace is in the near future.

    4. a reference design: not an openly marketed product

    5. a special solution is needed for a particular product

     

    These are my thoughts only. I am still working through the ideas and offering proposals to my bosses.

     

    Randall Scasny

    RoadTest Program Manager

  • in reply to rscasny

    I appreciate all your comments. I've been studying RoadTest by Invitations and I am trying to rethink how e14 does them. So everyone's input is being considered.

    Thanks.

     

    The RoadTest by Invitation does have special considerations, and it may be only open to certain people. (which is fine)

    The current problem is that it's visible to everyone in order to make it fit the existing framework on the site.

     

     

    I was wondering if you can have a special place that is hidden to the general membership, but is open to those whom you decide are being considered.

    Something akin to the TM area.

     

    For the Test you would create the necessary paging in that area, and add those memebers considered as potential applicants.

    Once the applications have been taken, the participants chosen and announced, then make it visible to the full membership.

    To everyone else the RT would appear as if they have been away for a month and the applications closed before they could apply.

     

     

    Mark

  • in reply to mcb1

      wrote:

    The current problem is that it's visible to everyone

    Yes, that really is a very fundamental flaw!

     

    And it's not just visible - as reported above, uninvited participants can still go through the entire application process!!

     

    image

     

    have a special place that is hidden to the general membership

    Absolutely.

  • in reply to mcb1

    Hi Mark,

    Just speculating, the software vendor may not have anticipated this use-case and justifying development with them for a thing that is infrequent might not be easy to do.

     

    (At one place where I worked in the past, I had to jump through hoops for internal orders for example - the system was crazy complicated, about 50 fields to fill in across multiple web pages before the system timed out - one error and the order would be rejected and start over! And the system got more complicated each year as finance/legal rules changed, and the changes were 'bolted on'. But no-one could justify the effort to create a project to streamline the process, because internal orders were rare for that company).

     

    There is a benefit, I guess if some people did accidentally apply for a roadtest-by-invite without noticing the closing date was so soon, perhaps if the application is very good, the vendor might consider and include them. Never say never I guess.