The Ohio Quizbowl Forum

Statistical Rankings
Page 1 of 1

Author:  eckj [ Tue Oct 31, 2017 11:11 am ]
Post subject:  Statistical Rankings

I was bored and wanted to find a way to rank teams statistically. This is obviously limited to the TU/B format. The data I use makes this “useful” for comparison of Ohio teams only. I was inspired by Tyler Benedicts work last year and used some similar data. I ranked teams based a formula using the adjusted PPB (aPPB) and adjusted power percentage (aP%). I adjusted the PPB and P% by using the average of all IS sets.

The formula I used to calculated the ARP (average ranked points ) number I ranked the teams on was:

(aPPB*aP%) + aPPB = ARP

The reason I chose to add aPPB was to prevent teams from having a zero ARP if their power percentage was 0.

Feel feel to critique and add anything you think would make it better! I am open to lots of suggestions.

I ranked middle school teams and high school teams. I did not use the stats for Solon A and Beavercreek A from their hosted tournaments because I know their real A teams did not play. Let me know if I missed stats anywhere!

Tournaments used:
-High School: Solon Fall, Scottie (KY), Brookfield Gathering, Miami Valley Fall, Beavercreek. Mellon Bowl (PA), Waynesdale, Columbiana
-Middle School: Northmont, Miami Valley Fall

Middle School
ms rank nov 1.PNG
ms rank nov 1.PNG [ 16.37 KiB | Viewed 4580 times ]

High School
rankings nov 1.PNG
rankings nov 1.PNG [ 98.45 KiB | Viewed 4580 times ]

Author:  trbenedict [ Wed Nov 01, 2017 12:06 pm ]
Post subject:  Re: Statistical Rankings

This looks really cool, Josh (and much more nicely conceived than my brute-force attempts last year)...good to have someone with some quantitative acumen crunching numbers for a change!

In particular, the treatment of power percentage seems better than my ham-fisted way of accounting for it last year, which was to do one set of rankings entirely based on aPPB, and another entirely based on aP%, then add the relative positions of both together (so a team who was 1st on the aP% list and 3rd in aPPB would have a combined ranking of 1+3=4, with 2 then being the best possible number). I think your way here, Josh, is a nice solution to get sound rankings without all that double-listing, position-adding and other nonsense. Kudos to you for calculating all those adjustments!

Author:  ppadmanabhan [ Wed Nov 01, 2017 7:46 pm ]
Post subject:  Re: Statistical Rankings

Thanks for doing this! I always love looking at different ways of ranking teams. Looking forward to seeing how more Ohio teams do as the season progresses!

Author:  eckj [ Thu Nov 02, 2017 6:07 am ]
Post subject:  Re: Statistical Rankings

Thank you both. I will continue to do it just for just for fun. I already made a slight adjustment to the stats to remove outliers when calculating the adjustment for the sets.

Author:  eckj [ Sun Nov 05, 2017 6:10 pm ]
Post subject:  Re: Statistical Rankings

Updated High School after Tippecanoe and Gahanna-Lincoln this weekend.

Author:  eckj [ Sun Nov 19, 2017 2:24 pm ]
Post subject:  Re: Statistical Rankings

Here is an updated: ... =227305641

I made a few changes:
1. I pulled data for all of the sets from tournaments outside of Ohio to calculate set adjustments. I was getting some weird adjustments because I did not have enough data points.

2. I decided to calculate APR using the teams BEST adjusted PPB and P% instead of using their CUMULATIVE adjusted PPB and P%. This seems more fair because as teams improve their ranking would be held down by their stats from earlier in the season.

Author:  eckj [ Thu Dec 14, 2017 10:10 am ]
Post subject:  Re: Statistical Rankings



Author:  eckj [ Sun Jan 14, 2018 8:25 pm ]
Post subject:  Re: Statistical Rankings

Major update.

I changed how I calculate adjustments and I am now using the average of a teams top two performances in P% and PPB.

I also labeled each teams region. I used this map

My calculations rely on teams playing IS or MS sets to compare to house writes, I do not have enough data to calculate adjustments so teams that have played CFMS 5/6, CFMS 7/8, SCOP HS, SCOP MS may have a score of 0.

MS: ... 1766095557
-No major changes

HS: ... 1684871096
-Bexley debuts at #9
-Dublin Scioto leapfrogs Solon into the #3 spot.

Breakdown By Region (Remember I am ranking every team I have TU/B stats for)
Northeast: Number of Teams (76), Avg. ARP (11.61)
Northwest: Number of Teams (61), Avg. ARP (9.80)
Central: Number of Teams (32), Avg. ARP (15.76)
Southeast: Number of Teams (15), Avg. ARP (11.61)
Southwest: Number of Teams (43), Avg. ARP (12.75)

Also, if any TD wants the raw data after/before adjustments for bracket placement I would be happy to share.

Author:  Get Lynned [ Sun Jan 14, 2018 9:07 pm ]
Post subject:  Re: Statistical Rankings

Damn, another impressive compilation. Thanks for taking the time to do this, Josh. I’m a believer that these quantitative efforts help legitimize Ohio’s Quiz Bowl circuit.

Author:  eckj [ Tue Jan 16, 2018 7:47 am ]
Post subject:  Re: Statistical Rankings

Thank you Tom. I like doing this and I have gotten some good feedback so far.

Author:  ThePocketProtector [ Tue Jan 16, 2018 9:50 am ]
Post subject:  Re: Statistical Rankings

Warning: My terrible sense of humor incoming.

Hey, look at that map! Columbus, Delaware, and Mount Vernon are in one region and Portmouth, Wheelersburg, and Ironton are in a different one. That doesn't seem right...

Okay, I got that out of my system. I know that the map isn't for the same purpose and there are many factors involved in our current regional map.

Josh, this is amazing. I'm greatly enjoying it. I'm glad that someone is doing this and there is actual data we can point to for things we have thought in the past.

Author:  eckj [ Tue Jan 16, 2018 1:10 pm ]
Post subject:  Re: Statistical Rankings

Thanks! I think the data could be useful once we have a whole season.

One thing I just looked at was numbers of the top 16 in each region. The southeast is lacking data right now so I only used the 8 teams that have data, but once your tournament happens I think I will be all set.

data.PNG [ 8.47 KiB | Viewed 3374 times ]

Author:  rmaupin [ Tue Jan 16, 2018 4:48 pm ]
Post subject:  Re: Statistical Rankings


I really appreciate all of the work that you have put into the statewide ranking data, it really does do a lot to help promote our sport. It was also interesting to see the state divided up into regions for comparing data. However, why did you organize the state into 5 regions instead of 6 regions (like what we have for OAC). I know that your data is based on NAQT results (and not OAC), however the six region OAC system is the only way that we have organized the state (because as far as I know, we have never had NAQT regional tournaments, just a state tourney). In our case at Little Miami we are in the SW region for OAC, and it would not include teams such as Beavercreek and Northmont because they are in the WC region. Hopefully this doesn't come off as nitpicking, rather just curious about the methodology used. Once again, thanks for all the work you do in putting together state wide data.

Author:  eckj [ Tue Jan 16, 2018 8:42 pm ]
Post subject:  Re: Statistical Rankings

It does not come back as nitpicky at all. I just chose these based on what most maps on Google were haha. I will make one with sub regions that fit the usual OAC regions here in the next couple days.

Author:  eckj [ Wed Jan 17, 2018 10:31 am ]
Post subject:  Re: Statistical Rankings

Okay. I took a very quick guess at where most teams would go for OAC Regionals. If there any teams you think should switch regions let me know. I may have misplaced a few.
SC TO NC.PNG [ 36.56 KiB | Viewed 3290 times ]

CN TO SW.PNG [ 73.34 KiB | Viewed 3290 times ]

Top 16 teams in each regional summary
summm.PNG [ 21.34 KiB | Viewed 3290 times ]

Author:  eckj [ Sat Jan 20, 2018 5:58 pm ]
Post subject:  Re: Statistical Rankings

1/20: Small update after Chillicothe today. The data from Chillicothe allowed me to get enough data for an adjustment for SCOP and tweak all adjustments a little.

Some shuffling occurred in the top-10, but nothing major. ... 1004929050

Author:  rmaupin [ Mon Jan 22, 2018 2:16 pm ]
Post subject:  Re: Statistical Rankings


Thanks for using the 6 region model, it looks great!

Author:  eckj [ Wed Jan 31, 2018 7:53 pm ]
Post subject:  Re: Statistical Rankings

Small Update

-I added a tab for the OAC Regionals Top 16 (Estimated Regions, not guaranteed) and Geographical Regions Top 16
-Highest climber was Waverly
- Hoping for a big update as leagues finish up!


EDIT: I also created a Small School tab with ranking for public and private. I would appreciate it if anyone would point out errors or omissions for the small schools.

Author:  eckj [ Sat Feb 03, 2018 6:53 pm ]
Post subject:  Re: Statistical Rankings

HS Update: ... =292419698
-Northmont climbs into the top ten.
-There are now around 300 teams in the data set!

Author:  eckj [ Sat Feb 10, 2018 6:36 pm ]
Post subject:  Re: Statistical Rankings

HS Update after Olmsted Falls:
-I will have another update this week when the stats for the Ashtabula ESC Tournament are posted.

Author:  eckj [ Thu Feb 22, 2018 9:57 am ]
Post subject:  Re: Statistical Rankings

HS update after Solon:

Author:  eckj [ Fri Feb 23, 2018 8:04 pm ]
Post subject:  Re: Statistical Rankings

MS Update after Solon

-Solon debuts at 3
-Ratner moves up three spots to 4th

Author:  eckj [ Mon Feb 26, 2018 9:09 am ]
Post subject:  Re: Statistical Rankings

MS update after Copley:

Author:  eckj [ Mon Feb 26, 2018 7:21 pm ]
Post subject:  Re: Statistical Rankings

On interesting thing I noticed about the middle school stats is that out of 95 NAQT MS set data points there has only been one team to have a PPB over twenty for a tournament all season long. Seem like our MS circuit is a little weak after looking at other MS results.

Author:  eckj [ Tue Mar 06, 2018 3:05 pm ]
Post subject:  Re: Statistical Rankings

HS Update:

Author:  eckj [ Sun Mar 11, 2018 3:31 pm ]
Post subject:  Re: Statistical Rankings


Here are the adjustments for each set so far.
adj march.PNG
adj march.PNG [ 8.72 KiB | Viewed 829 times ]

Author:  eckj [ Sun Mar 18, 2018 5:58 pm ]
Post subject:  Re: Statistical Rankings

Tiny update after Boardman

There are 3 pending HS and 3 pending MS tournaments on NAQT right now so I am hoping for a big update soon!

Page 1 of 1 All times are UTC - 5 hours
Powered by phpBB® Forum Software © phpBB Group