Hardy: Why Plesius deserves a better ranking | CFL.ca | Official Site of the Canadian Football League
 
THE CANADIAN PRESS
 

In its most recent rankings of draft eligible players, the CFL Scouting Bureau ranks Frédéric Plesius – a Linebacker from Laval University – as the fifth most attractive prospect.  

However, based on his performance at the CFL Evaluation Camp presented by Reebok in early March, I believe a higher ranking for Plesius is justified.  

As you likely know, CFL Evaluation Camp puts draft hopefuls through a number of individual tests.  Among these tests are a bench press, 40-yard dash, vertical jump, broad jump and shuttle.  

Based on the results of these tests, Plesius should be ranked higher than fifth. Let me explain:

Since 2006, a total of 311 players have participated in E-Camp (not including kickers and quarterbacks, who have been excluded from this analysis).

Most – but not all – of these players participated in all E-Camp tests, providing a basis to rank their performance.  In other words, a player who ran the 40-yard dash in 4.45 seconds ranks higher than another player who ran it in 4.62 seconds.

Comparing Apples to Oranges: Standardizing Data

Now, it’s probably not very fair to compare the 40-yard times of a receiver to the 40-yard times of an offensive lineman.  It’s kind of like comparing apples and oranges.  That’s okay, because a statistical method known as “standardization” allows us to convert the 40-yard times of all positions so that they are comparable, so long as the 40-yard times are distributed “normally”. 

A “normal” distribution looks like a bell curve.  For example, the distribution of receiver 40-yard dash times from 2006 to 2012 looks like this: 


Every normal distribution can be defined by its mean (about 4.7 seconds for receivers) and its standard deviation (about .15 for receivers).  

What the normal distribution implies is that most observations of any given “experiment” tend to settle around an average, or “mean”, and there will be gradually fewer observations as you move further from the mean.  

In the case of receivers above, most 40-yard dash times tend to be around 4.7 seconds, with a few of 4.4 seconds and less, and a few of 5.0 seconds and more.

Having assured ourselves that the data for E-Camp results are normally distributed, one can perform a calculation (using the mean and standard deviation for each position’s test results) that converts the test results for each position represented at E-Camp to a single, standard measurement.  The calculation is performed using the following formula:
The Rankings

So, what does this all mean for Frederic Plesius? Well, having performed the necessary calculations to standardize the E-Camp data, as described above, I was then in a position to rank player performance. 

The best performance at Evaluation Camp in recent history belonged to Michael Montoya in 2010.  Incidentally, Montoya, a Running Back from Wilfrid Laurier University, was never drafted, despite producing the top marks of the entire class.

For his part, Plesius registered the following ranks:

Test Rank (out of 311)
Bench Press 35
40-yard Dash 13
Vertical Jump 19
Broad Jump 329
Shuttle 231
Total 627

Of the top 15 Players ranked by the CFL Scouting Bureau (11 of which attended Evaluation Camp), Plesius’s performance was the best.

The Importance of Evaluation Camp in the Draft Decision

I suppose you may be thinking that the example of Montoya demonstrates that CFL general managers and scouts are looking at other skills that are not tested at Evaluation Camp. 

However, we have clear statistical evidence that the majority of tests conducted at Evaluation Camp do, in fact, impact the draft decision. In other words, the athletes that test better at Evaluation Camp are more likely to be drafted.

Allow me to explain:

The “pool” of all Players that have attended E-Camp can be separated into two groups: those that were drafted and those that weren’t.

Each of these two groups is defined by the individual performances on the Evaluation Camp tests.  By compiling and comparing these results, we can determine (with a predetermined amount of confidence, known as the “confidence” interval) whether these groups are different.  

The statistical test performed to answer this question is known as a Two-Sample T-test.

For each of the Evaluation Camp tests we used in our analysis – the Bench Press, 40-yard Dash, Vertical Jump, Broad Jump and Shuttle – the results of the drafted group were significantly different than those of the undrafted group.  That is – Evaluation Camp results matter.  

And Frédéric Plesius performed better than any of the other top CFL prospects.

About Trevor

Trevor Hardy is the CFL's Director, Salary Expenditure Reporting, responsible for the administration of the league's Salary Management System. A Chartered Accountant, He is also one of approximately 225 designated CA specialists in Investigative and Forensic Accounting in Canada. Trevor is an expert in the use of analytics, statistical modeling and forecasting.

Fan Comments
Imiss86
Plesius managed to rank 329 out of 311 in the Broad Jump?
May 02, 2012 - 12:55pm
thardy
Good catch. The reason for the inconsistency here is that we have excluded some Players that attended ecamp from consideration(Quarterbacks and Kickers, for example) in our analysis, but these Players still get "counted" in the rankings. Suffice to say, Plesius didn't perform very well in the Broad Jump!
May 03, 2012 - 11:09am
 
als rule
don't agree!!
May 02, 2012 - 11:57am
Imiss86
I don't either but that's what the table says.
May 03, 2012 - 10:06am
 
Leaderboard
DrillLeaderResult
Bench Press
David Menard 33
40-Yard Dash
Adam Thibault 4.45
Vertical Jump
Evan Pszczonak 40.00"
Broad Jump
Andrew Lue 10'5.00"
Shuttle Adam Thibault 4.03
3-Cone Antoine Pruneau 6.78

View Full  Results >    

Video
 
Meet Laval speedster Adam Thibault. The...
Posted:
 
 
The Calgary Stampeders met with Combine...
Posted:
 
 
The REDBLACKS are working hard to build their...
Posted:
 
 
Western University LB Beau Landry met with the...
Posted: