Actions
Forum Thread Details
  • Replies 70 replies
  • Subscribers 2567 subscribers
  • Views 5774 views
  • Users 0 members are here
Related

Roadtesting stats

neuromodulator

Today out of boredom and curiosity, motivated by other posts on site stats I decided to compute some stats of the published roadtests. There are a couple of interesting things that can be computed and would be interesting to know, specially in terms of correlations. For instance, do member points increase the chances of winning expensive items? What about number of posts? There are many questions I was wondering about to better understand the dynamics of the system. One of the first questions (and easiest to answer with my data) was how many users have won and published different amount of roadtests. And the results I obtained were these:

 

1: 359

2: 68

3: 32

4: 11

5: 9

6: 10

7: 7

8: 2

9: 0

10: 2

11: 3

12: 1

13: 1

14: 2

15: 0

16: 0

17: 1

18: 1

 

That is, 356 users have won and published 1 roadtest, and 1 user has won and published 18 roadtests. Ideally I would like to count won roadtests (not just published ones), having such data would also be useful to calculate the number of users that win roadtests and never publish anything. Other interesting stats could be to analyse trends, for instance, have the number of words in roadtests reviews increased? As the competition has gotten harder, I would expect to see some visible trends since the beginning of the roadtesting program.

Parents

  • It would be interesting to know the remarkable people in the category

     

    12: 1

    13: 1

    14: 2

    15: 0

    16: 0

    17: 1

    18: 1

     

    image

  • in reply to snidhi

    Sure, here they are:

    1: 359

    2: 68

    3: 32

    4: 11 ['dixon415', 'ralphjy', 'Fred27', 'waelect', 'ninjatrent', 'ciorga', 'clem57', 'greenben214', 'tayken', 'manlong', 'bhaveshj']

    5: 9 ['gordonmx', 'packetgeek', 'jkutzsch', 'jancumps', 'WarrenW', 'matfur92', 'Workshopshed', 'violet', 'rwslaugh']

    6: 10 ['Kilohercas', 'mcb1', 'michaelwylie', 'Nitin_Bhaskar', 'geralds', 'sakthi.1260', 'DAB', 'mconners', 'dwinhold', 'refaqtor']

    7: 7 ['gam3t3ch', 'balearicdynamics', 'nermash', 'ljakes', 'Instructorman', 'ss_shrenik', 'gregoryfenton']

    8: 2 ['s2000gt', 'jdlui']

    9: 0

    10: 2 ['MARK2011', 'fvan']

    11: 3 ['gsgill112', 'lui_gough', 'peteroakes']

    12: 1 ['dougw']

    13: 1 ['kas.lewis']

    14: 2 ['gpolder', 'ipv1']

    15: 0

    16: 0

    17: 1 ['hlipka']

    18: 1 ['shabaz']

  • in reply to Fred27
    I'm counting posted roadtest reviews

    That in itself is interesting.

    I wonder how many are 'picked' but not posted ...

     

     

    What might be more useful - especially for the E14 staff

     

    It looks like the information is available ... just not published.

     

     

    I don't think the numbers of tests for an individual are anything on their own.

    Many of the people with multiple tests have the resources and ability to write good applications.

     

    I don't envy Randall's job as even now we have comments about where to find the information about applications, and people think it's a matter of saying 'pick me'.

    We need to remember the applications that meet the requirements are passed onto the supplier to decide, so you have to convince them why you want to test their product.

     

    At the very least you can show you've read the material they have published......

     

     

    Mark

     

     

  • in reply to Dudley

    Nice stats Dudley.

    I'm sure there are lots more.

     

    Mark

  • in reply to mcb1

    Correctly pointed, Mark.

     

    I was just wondering, How can you apply for something you want to learn while doing Roadtest, Something like FPGA's for me; And convince that you can do the roadtest.

     

    As you yourself would be going through an extensive Learning Curve !!

     

    Regards,

    GS Gill

  • in reply to gsgill112

    My personal feeling is that it really depends on the particular product and company whether this is an approach they value.

     

    If they want to know how the product is being perceived by someone without much experience in the area, then they might choose an application which reflects this. But other times, they're probably interested in someone who can show off what the product can do or push it to the limits - then it doesn't make as much sense to choose someone who is "learning" about the product as the learning curve might just be too steep (resulting in those reviews which "give up" because an example wouldn't build and had some error message). That would be a risk to the company as it might make the product look bad, but also they're out of pocket with a potentially expensive product sent to a "learner" who couldn't overcome a barrier.

     

    So I think the answer is that - for some products, if you don't have the experience already, it might not make sense for them to choose you. Likewise, in that case, it probably makes sense to learn some on your own if you can or choose RoadTests where this may be more valuable (e.g. very fresh products targeted at beginners) to build up knowledge and experience first.

     

    - Gough

  • in reply to COMPACT

    Hidden in the noise with 2 reviews by the "RoadTest" type scrape metric I suspect ...

  • in reply to rscasny

    Hahaha ... I think the STOP sign Is iconic and will indeed push the applicant to stop and read the warning.  May be an "!" Sign will go the trick image

     

    //Guri

  • in reply to Gough Lui

    Well put.

    That was exactly what I was thinking for answering

    I've have avoided RT's where I don't have the skills (or equipment) to do a proper test.

     

     

    I'd really think twice about submitting a proposal if it were to be publicised

    I'm struggling to understand just what secrets would be in your accepted proposal (as in you have been selected to do the Road Test) that you can't share ..... (personal details redacted of course)

    This is a proposal for Road Tests (although the Design Challenge also fits) and you're happy to provide those details to the element14 staff and a sponsor (or sponsors).

     

    Mark

Reply
  • in reply to Gough Lui

    Well put.

    That was exactly what I was thinking for answering

    I've have avoided RT's where I don't have the skills (or equipment) to do a proper test.

     

     

    I'd really think twice about submitting a proposal if it were to be publicised

    I'm struggling to understand just what secrets would be in your accepted proposal (as in you have been selected to do the Road Test) that you can't share ..... (personal details redacted of course)

    This is a proposal for Road Tests (although the Design Challenge also fits) and you're happy to provide those details to the element14 staff and a sponsor (or sponsors).

     

    Mark

Children
  • in reply to mcb1

    I don’t necessarily think it would be too much Mark, probably things similar to those “obvious” personal details you mention being redacted - you know, the things that go without saying sometimes!

     

    Some of my Roadtest applications have taken advantage of customer work and on-site testing that wouldn’t necessarily be appropriate to publish quite so openly, and I imagine some other people may have similar.

     

    Whilst it’s only a small thing, it would still be a barrier to automatically publishing accepted applications.

     

    A