Blog Actions
Group Actions
Engagement
  • Author Author: Instructorman
  • Date Created: Date Created
  • Views 2528 views
  • Likes 9 likes
  • Comments 22 comments
Blog Details
Related
Recommended

Observations on point accumulation by the top 60 Element 14 members

Instructorman

Observations on point accumulation by the top 60 members in Element 14

Back in October of 2015 Element 14 announced its first Hertz level member, who, at the time, was .  The Hertz level starts at 100,000 points, which in the Element14 community is really a lot of points.  Accumulating that many points is no easy feat, as I will illustrate in this blog.

On the day I read the announcement, just over a year ago, I checked my point accumulation and found I had 7051 points, placing me 61st in line to the throne.  I wondered about how the community in general was doing in terms of point accumulation because point accumulation can be a good proxy indication of member participation.

 

Point accumulation is not 100% correlated with member participation.  A strong case supporting this assertion can be found in the very prolific and highly participatory   who is not among the top 60 members ranked in the chart below. From April 2016 to October 2016 Ben slipped from 64th to 81st position. Clearly, this does not mean Ben has been participating less over the last year, it means that he has been concentrating on making valuable contributions through The Ben Heck Show.  I think it is quite possible that Ben's contribution to the community through The Ben Heck Show has inspired many members to increase their participation, helping them move up the ranking scale.

 

Nevertheless, observing point accumulation should provide the temperature of member activity and plotting member activity over time should provide insight into the climate of the community.  With this hypothesis in mind I started a spreadsheet to record the point accumulation of the top 60 members in the community longitudinally, or, over time.  I could have selected the first 100, or the top 50, but because I was sitting just on the other side of 60 I arbitrarily decided to track the top 60 members.  I have maintained the spreadsheet for the last year and would like to share the chart below with the community because I believe other members and element14 administrators might find it interesting.

 

The process I used to gather data for the spreadsheet is pretty straightforward, if perhaps a little cumbersome.  It went like this:

  1. Log into my E14 account
  2. Select Reputation and Points from the drop down menu next to my name.
  3. Select Ranking from the Activities list on the left side of the screen. Doing this brings up a screen that shows your point accumulation and rank in the middle of a field, with the 5 members ranked above you and the 5 members ranked  below you arranged in a column.
  4. Record point accumulation and rank for everyone shown on the screen in the spreadsheet.
  5. Select the member at the top of the screen.
  6. From the More drop down menu, select Reputation
  7. From the Activity list, select Ranking.  This will produce a screen of ranking information with the selected member placed in the middle of the field. Repeat from step 4 until the rank of the member at the top of the list equals one.

 

For reference here is a link to the point accumulation rules and the levels currently established by element14.

 

The chart below illustrates the progress in point accumulation for the top 60 members of the element 14 community from October 27, 2015 to October 27, 2016.

The vertical axis represents the number of points accumulated, obtained via the method described above.  The horizontal axis represents member ranking from 1 to 60,  The third axis, the depth axis, contains a series of snapshots taken through the year, each one labelled with the date the snapshot was taken.

image

 

Several observations can be made from this chart.

 

First, the vertical axis is pretty much asymptotic around the top point accumulator. There isn't enough data on the horizontal axis to confirm this, but it looks like the horizontal axis is pretty much asymptotic to member rank as the rank number increases above 50 or so. I explored a bit well beyond the 60th ranked member to see what the chart would look like out there.  Now I couldn't determine exactly how many members there are in the Element14 community because odd things happen when member rank numbers get into 5 and 6 digit territory.  For example, I know of three members that have less than 100 points accumulated.  These members have ranking numbers ranging from around 36,000th to around 228,000th.  So there are probably at least 228,000 members in the database. However, the ranking system breaks down at high rank numbers because multiple members have the same rank position if they have the same low point accumulation number. For example, at least 6 members share rank position 31,851.

 

From examination of the data set gathered over a year, I believe I see a very large number of inactive, or barely active members, and a small clutch of moderately to highly active members, likely under 200 in total. I may be wrong.  The data set I gathered is incomplete, so I am making inferences and my conclusions are certainly open to debate. The chart does not show this well, but the raw data shows that some members shoot up through the ranks over a relatively short period of time, then stop advancing.  Others have steady point accumulation over time, using various participation strategies, advancing up the rank at various paces.  None of the members on the chart have activity levels as frenetic as the levels achieved by the top three members.

 

As can be seen from the chart, the top three members are very active.  The number 1 position has advanced by 44,598 points in the one year time span displayed in the chart.  Ownership of the top member position, by the way, has changed hands several times among the top three.

 

Here is a question:  If Element14, as a community, has a desire to increase awareness and participation in electronics/computing as a hobby or as a career, should more be done to encourage participation among the many thousands of inactive or barely active members?  Is this a topic of interest to the membership?

Parents

  • Very interesting observations.

     

    Victor used to do some other analysing based on login frequency.

    He reached a similar conclusion about numbers of very active members.

     

    Many at the top of the list undertook quite a few Design Challenges. These take some effort and will generate quite a few points based on content, likes, etc.

    Some of these challenges were complex and wouldn't have suited others, so I believe they have been cut back.

     

    You are right about the changing of the list. For me personally I've had other personal priorities in the last year, so my contribution has been much less.

    Often I'd like to provide assistance, but the reality is I don't have the time available.

     

    There was also a cleanup of the points system to remove anyone that was staff, supplier and 'paid' blogger, which will have changed some rankings, but overall the results won;t have changed.

     

     

    My question to you is ... what would you suggest to encourage participation.

    You've been here for nearly 5 years, so do you consider yourself active.?

     

    From my observation there are a large number of members who see this as an alternative to search engines in order to seek the answer to their assignment.

    Others simply sign up for the freebies.

    There is no reason they can't be accepted for a Design Challenge or Road Test as each application is read and considered on it's own merit regardless of their ranking in the community.

     

    Participation is not a new problem, and like many things you get out what you put in, so some effort on their part may give exponential rewards.

     

     

    cheers

    Mark

Comment

  • Very interesting observations.

     

    Victor used to do some other analysing based on login frequency.

    He reached a similar conclusion about numbers of very active members.

     

    Many at the top of the list undertook quite a few Design Challenges. These take some effort and will generate quite a few points based on content, likes, etc.

    Some of these challenges were complex and wouldn't have suited others, so I believe they have been cut back.

     

    You are right about the changing of the list. For me personally I've had other personal priorities in the last year, so my contribution has been much less.

    Often I'd like to provide assistance, but the reality is I don't have the time available.

     

    There was also a cleanup of the points system to remove anyone that was staff, supplier and 'paid' blogger, which will have changed some rankings, but overall the results won;t have changed.

     

     

    My question to you is ... what would you suggest to encourage participation.

    You've been here for nearly 5 years, so do you consider yourself active.?

     

    From my observation there are a large number of members who see this as an alternative to search engines in order to seek the answer to their assignment.

    Others simply sign up for the freebies.

    There is no reason they can't be accepted for a Design Challenge or Road Test as each application is read and considered on it's own merit regardless of their ranking in the community.

     

    Participation is not a new problem, and like many things you get out what you put in, so some effort on their part may give exponential rewards.

     

     

    cheers

    Mark

Children
  • in reply to mcb1

    @Mark,

     

    I consider myself a moderately active member.  Like many other members, I have a full time job in the electronics industry that keeps me occupied every day and has an annoying tendency to drain my capacity to engage.

    You suggested that

    mcb1 wrote:

     

     

     

       ...there are a large number of members who see this as an alternative to search engines in order to seek the answer to their assignment.

    Others simply sign up for the freebies.

     

    I agree.  Participation needs to be incentivized in a way that satisfies the personal motivations of each member.  When a member gets what they came for and no further incentive remains to retain them, they will likely stop participating.  I am incentivized by Road Test, which is a phenomenal perk available only at Element14, as far as I know.  I am not sure why more members are not all over this program.  Maybe it because that, in addition to a sweeping generalization that engineering personalities tend to be introverted, one could also suggest many have less-than-stellar writing skills. If true, could this be holding some members back from greater participation?

     

    You also noted that "Participation is not a new problem, and like many things you get out what you put in, so some effort on their part may give exponential rewards."  If E14 participation points are a kind of reward, and that is debatable, then it will take inordinate and sustained effort for the vast majority of members to make any sort of progress toward exponential achievement.  The existing point accumulation scheme seems designed to thwart participation.  Consider how much effort is required to transition from one level to the next.  Advancing to level 2 from level 1 is recognized after accumulation of 500 points; something that casual participation could achieve in a month or two. However, moving from level 7 to level 8 requires the accumulation of 25,000 points.  Over the last year, at my moderate level of participation I accumulated 5499 points.  At this rate, it would take me about 4 and half years to accumulate 25,000 points.  And why would I want to?

     

    The point accumulation scheme at E14 seems, pardon the pun, pointless.  If it is meant to incentivize participation, then there should be clearly evident incentives to reach new levels, not higher mountains to climb at the conclusion of every ascent.

     

    I think members will extract value from participation in proportion to the effort they put into participation.  Nothing much can be done to motivate the tens of thousands of idle account holders.  They are likely gone.  A restructuring of the point accumulation system to incentivize participation with rewards (unlocking access to forums, contests, etc.), plus provision of additional member supports, like tutorials on writing solid Road Test applications and reviews, would maybe help draw in sideline members and pump up participation rates. I applaud the efforts of members like that have produced tutorials on writing a Winning RoadTest Application and How to Write a RoadTest Review.  I think efforts like these will help.

     

    Mark