Friday, May 26, 2017

Stats Explained

Author's Note: This is the second part of a 36,000-word project I drafted earlier this year and have long been considering releasing as an e-book. The introduction is available by clicking hereAny feedback is appreciated.



This book relies heavily on statistics. It is my belief that statistics demonstrate very well what a player has done on the field. Statistics were not invented in 1990 by fantasy sports nerds. They have a purpose.
The eye test, when available, can still fail, both for the uninformed and sometimes even the quite well-informed. The only true eye test doesn’t work without seeing all 22 players on the field, and that is not available except the last couple seasons. Not everyone can watch the games, either, and those who do have memories that can fail or fade over time.
Plus, I love numbers. If you have them, I will use them.
Every football fan owes a tremendous debt of gratitude for the folks at Sports Reference and Pro Football Reference for their fantastic work. Their scoring summaries, game logs, and Play Index provide a great deal of information in this book beyond just total season statistics. I’m sure almost every football fan is familiar with their work, but head on over to www.pro-football-reference.com anyway to check them out. The Play Index (at www.pro-football-reference.com/play-index) is a particularly great tool for finding cool statistics.
That being said, here are the rate statistics that appear throughout the book.
Passer Rating
Passer rating is the official NFL metric of passing efficiency. It creates a single number out of a passer’s completions, yards, touchdowns, and interceptions per attempt. It was invented in 1973 and immediately implemented by the league. Passer ratings in seasons prior to 1973 became official retroactively.
Adjusted Yards per Attempt
Adjusted yards per attempt (AY/A) takes a passer’s yards, credits them 20 yards for touchdowns, demerits them 45 for interceptions, and averages yards per attempt. It is generally considered a more accurate measure of a quarterback’s performance than passer rating, and is used here through the 1968 season.
Adjusted Net Yards per Attempt
Adjusted net yards per attempt (ANY/A) is AY/A but with sacks taken into account. QB sack data is available for 1969 and beyond. This book uses AY/A through 1968 and ANY/A for 1969-present.
All else equal, if passer rating points to one quarterback, and AY/A or ANY/A to the other, I will lean towards the QB with the better ANY/A.
Fourth Quarter Comebacks and Game-Winning Drives
These are abbreviated as 4QC and GWD. The numbers are based on research by Scott Kacsmar, which Pro Football Reference adopted. A fourth quarter comeback means the team was trailing and came back; if the final score is a tie, a QB can still get credit for a fourth quarter comeback. A game-winning drive can come in a tie game, but must win the game, obviously.
Defense-adjusted Yards Above Replacement (DYAR) and Defense-adjusted Value Above Average (DVOA)[1]
These numbers come from www.footballoutsiders.com and are all publicly available on their website, which I recommend to you. The site has been around for over a decade and is very well established and respected. They describe their signature stat, DYAR, thusly: “the value of the quarterback 's performance compared to replacement level, adjusted for situation and opponent and then translated into yardage.” Meanwhile, DVOA “represents value, per play, over an average quarterback in the same game situations. The more positive the DVOA rating, the better the player's performance. Negative DVOA represents below-average offense.”[2] DVOA is depicted as a percentage above average, so 0.0 is exactly average.
Football Outsiders has calculated DYAR and DVOA for every season from 1987-2016. It is used here when available. For the seasons from 1987-2005, it is the only defense-adjusted statistic mentioned. That changes for 2006 because…
Total Quarterback Rating (QBR)[3]
This is ESPN’s stat. More accurately, it is the ESPN Stats & Information Group’s stat, so it’s not just a made-up number created by a bunch of talking heads on a stage.
QBR can be a controversial stat, but passes the smell test more often than not.[4] It is a rate stat, comparable to passer rating, ANY/A, and DVOA. It includes rushing plays as well.
The main benefit of QBR is its attempt to split up a quarterback’s contributions to his own stats from those of his receivers.[5] QBR is available from 2006 onward and, like the Football Outsiders stats, it adjusts for strength of opponent.
There are multiple numbers ESPN makes available that go into QBR. Because QBR is a rate stat, I will also use Points Added, which is a cumulative stat that ESPN describes as the “number of points contributed by a quarterback over the season, accounting for QBR and how much he plays, above the level of an average quarterback.” It is unclear whether this number is adjusted for opponent.
QBR operates on a 0-100 scale, with a 50 being average.[6]
Use of Stats
I did not create any sort of algorithm that tries to incorporate passer rating, ANY/A, DYAR, and QBR into a single number and just go with that each season. Instead, every factor is considered, including the raw completion, yard, and touchdown totals. 

The selections are thus ultimately subjective, which is why you're allowed to disagree!

Note: If you missed it in the introduction, I've also published my review of 1977 as a sample chapter, available here.




[1] All Football Outsiders numbers in this book are freely available on their website.
[2] These definitions are found on every one of their QB leaderboard pages, e.g. http://www.footballoutsiders.com/stats/qb2016. Such pages are also, of course, my source for these numbers.
[3] All QBR numbers from 2006-present can be freely accessed through the URL http://www.espn.com/nfl/qbr.
[4] There have been 15 qualified quarterbacks to put up a QBR of 80 or better in a season: Peyton Manning four times, Tom Brady three, Aaron Rodgers and Drew Brees two each, and Tony Romo, Dak Prescott, David Garrard, and Matt Ryan once each. Garrard’s season, in which he threw 18 touchdowns vs. only 3 interceptions, had by far the fewest plays in the group; in a larger sample, he might well have fallen below 80. “NFL Total QBR - All-Time Best Seasons,” ESPN.com, accessed March 1, 2017, http://www.espn.com/nfl/qbr/_/type/alltime-season.
[5] For more on this, see http://www.espn.com/nfl/story/_/id/6833215/explaining-statistics-total-quarterback-rating. This article was ESPN’s introduction of QBR. The most significant change to QBR since then is that it now contains an opponent adjustment, a change announced in 2016 at http://www.espn.com/nfl/story/_/id/17653521/how-total-qbr-calculated-explain-our-improved-qb-rating.
[6] Although, over the years QBR’s have seemed to me to be rising. I haven’t been able to find or get an answer from ESPN Stats & Info as to why.

4 comments:

  1. I have official sack data back to 1963 and sack yards lost dating back to 1947, in case you are interested.

    ReplyDelete
    Replies
    1. Thanks for the offer. You can send them to hscer dot sporcle at gmail

      Delete
  2. For PFR's index stats, 115 is not 15% better than league average; it is one full standard deviation above average. The formula is 100 + SD*15

    ReplyDelete
    Replies
    1. Thanks, Adam corrected me on that too but I didn't come back to it. I've just gone ahead and deleted that section since it ultimately doesn't play much of a role throughout the analyses.

      Delete