Viva El Birdos: An SB Nation Community

Navigation: Jump to content areas:


Sports blogs for fans, by fans.
New Blog: The Boxing Bulletin for Boxing Fans!

The Cost of WAR

As most of you know there has been quite a bit of discussion here about valuing free agents, with most of the discussion being tied to wins above replacement (WAR).  The really smart guys will tell you that the cost of a win above replacement on the free market is somewhere between $4.5-5M .  I don't know what they might say about the potential long-term impact of this season's free agent contracts on the future market value of a win.  The common thread at VEB has been, "let's sign player X for $9-10M because he is a 2 WAR player".  I wondered why our front office never really seemed to be making "market" offers based on this valuation method, so I started to do a little research. 

I used free agent salary data from espn's free agent tracker  and WAR data from fangraphs.  Since the espn site only has data for the past three off-seasons, I have only attempted to draw conclusions based on the 2006-2008 timeframe.  Obviously, data for the current off-season is still incomplete, but the picture is somewhat clear. 

I doubt that any of this information comes from a large enough sample set to actually "prove" anything, but I think it is sufficiently valuable to stimulate some conversation nonetheless.  What I have done is simply take the average annual value of each free agent contract without regard to any incentives, deferred money, or back loading and divided each player's WAR for the season completed immediately prior to signing the contract in order to obtain a cost per WAR for each free agent.  Then I have compared the costs for each WAR range and also compared the cost to the succeeding season's performance. 

According to this admittedly simplistic look at the data, 2006-07 free agents were paid an average of $4.2M per WAR which is pretty close to what you would expect.  For 2007-08 that number drops to just under $3.8M and currently sits at just over $3.3M for 2008-09.  If you dig a little deeper it gets more interesting.  It is extremely difficult to value certain classes of low WAR players like relief pitchers, aging players, and near-replacment bench types. 

When the data are separated into two buckets and you look at the <1 WAR players separately it is stunning to see the effect.  For example, in 2006-07 there were 78 free agents signed with a 2006 WAR below 1.  In fact, there were 28 players signed who posted 2006 WARs that were negative - indicating they were below replacement level.  The bulk of these were relief pitchers and players coming off injuries.  These players signed free agent contracts totaling over $200M in annual value despite a cumulate 2006 WAR rating of 9.2, making for a cost per WAR of nearly $22M!  That certainly skews the cost per WAR for the players who actually have significant value. 

There were 55 players in 2006-2007 who signed free agent contracts worth a total of over $400M in annualized value.  These players 2006 WARs totaled 135.6 for a cost per WAR of just under $3M.  A similar, but not quite so dramatic, difference can be seen in the numbers for the succeeding seasons.

During the 2007-08 off-season there were 50 contracts signed by free agents with 2007 WAR values below 1 for a total of over $130M.  There cumulative WAR total was 14.2 resulting in a cost per WAR of over $9M.  In the same period the 36 >=1 WAR players signed contracts totaling almost $266M for a cost per WAR of just over 2.9M - nearly identical to the 2006-07 class.  During the current off-season, 51 players with 2008 WAR <1 have signed for a total of over $95M resulting in a cost per WAR of just under $7.9M.  The >=1 WAR group has seen a modest decrease in pay with an average price of just under $2.8M per WAR.   

There are a couple of interesting conclusions here:

  1. If you are a marginal player, or a relief pitcher, or any other near-replacement type then your value is dropping precipitously.  The <1 WAR group has seen its value plummet by nearly 65%. 
  2. When we talk about the value of significant free agents, $4.5M per WAR is much more than the market seems to have been paying.  In 2008 only two players out of 20 with 2008 WARs above 2 signed contracts worth more than $4.5M per WAR.  They were Kerry Wood at about $4.7M and Raul Ibanez at $4.56M.  Other than those two players, the highest cost per WAR was one Brian Fuentes at $3.5M.  CC Sabathia was at a cool $2.99M.  The numbers aren't much different for 2006-07 and 2007-08.

I have posted the complete data if you care to look at the details.

Some explanations of the column headings: 

  • The column headings with years (i.e. 2008-09) represent the value per win based on the preceding season's WAR.
  • The column headings with "Actual" in the heading indicate the cost per WAR of the players in the year they actually earned the money.
  • "% Incr" is how much more (or less) the given group cost than the value assigned at the time of contract signing. 

I would be curious to hear whether the community thinks that WAR undervalues bench players and relief pitchers or whether "baseball men" put too much value on situational context.  

 

8 recs  |  Comment 50 comments

Story-email Email Printer Print

Comments

Display:

interesting work.

about this section on less than one war players: are you introducing a problem by failing to account for the value of a replacement player? if we create a threshold for a replacement value player, that will take something off the strange results you found.

so, if 30 teams hire 90 replacement level players, the replacement value players still won’t work for free. they’ll cost at least the league minimum. which means that the players will cost $36M but won’t be worth a single win above replacement. and that would give you an infinite dollar value per war, because you’d be dividing by zero. but do we really want to say that it makes no sense to pay league minimum for a backup catcher, LOOGY, etc.? replacement value isn’t nothing — every team has to have a few: brad thompson, larue, etc.

by tom s. on Feb 18, 2009 5:53 PM EST reply actions   0 recs

Good catch

If I substract out $400,000 from the salary of each <1 WAR player for 2008-2009 the cost per WAR drops from $7.9M to $6.2M. I guess I should make that calculation across the board.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 18, 2009 6:28 PM EST up reply actions   0 recs

Yes, definitely.

Also, if your pool of <1 WAR players comes from 2006, you’ve likely pick a group of players who underperformed, either by quality or playing time (as you’ve noted). So you’d want to use their 2007 WAR to judge the contracts. Actually, you’d want to use their PROJECTED 2007 WAR to judge their contracts, but that’s a little trickier.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 19, 2009 9:25 AM EST up reply actions   0 recs

That's what I wanted to do

but I couldn’t find a comprehensive source. I looked at your community projection WAR spreadsheet, but it didn’t seem to be complete.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 9:52 AM EST up reply actions   0 recs

Good to see an analysis

If video killed the radio star, maybe sabermetrics killed the veteran bench player.

Sign someone who can pitch, then let this team play.

by IL and StL Fan on Feb 18, 2009 11:18 PM EST reply actions   0 recs

Good analogy

but maybe an unwillingness to play for a market-based salary as well. Unless a guy has the ability to affect ticket sales like maybe a Griffey, a replacement level player needs to play for replacement level money.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 18, 2009 11:29 PM EST up reply actions   0 recs

It all depends on

whether he is the 1.9 WAR player he was in 2008 or the replacement level (or below) player he was for pretty much the rest of his career.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 3:19 PM EST up reply actions   0 recs

he might have a higher batting average last year

but he has very little power and is just average at OBP (at best)… and he’s just ok at D

by Cards Fan in Chitown on Feb 19, 2009 3:30 PM EST up reply actions   0 recs

Yeah

it sure looks like a BABIP-fueled BA that is totally out of line with the rest of his career pushed his value up in 2008. He will have to sustain that .343 BABIP for the next two years or the Cubs will end up paying him about $25M per win as his previous career-best WAR was .1.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 3:54 PM EST up reply actions   0 recs

great post

I’ve heard in the past (and it makes some sort of sense in my mind) that, because the division of talent in MLB isn’t even (it’s more of a bell curve with the majority of talent clustered around the 0-1WAR range) that there should be some sort of premium on high-win players. That is, because it’s quite easy to find 1-ish WAR players to fill any position (examples this off-season for fairly rare positions – Odalis Perez was signed on a minor league deal, Craig Counsell is still available and could presumably be had for <$1m) that the more valuable players (3-4 win guys, for example) should cost more per win than the scrubs. This should especially be the case when your team is high up the win curve (i.e. the Cubs should be paying more per marginal win than the Nats as their team is harder to make marginal improvements to).

However, it seems your data goes totally against that.

Perhaps the latest “market inefficiency” in MLB is superstar (i.e. 3-4 win+) players being underpaid! Who’d a thunkit?

I’m guessing that part of the reason is the scarcity of those sort of players – in any given offseason, there might only be 1 or 2 stars available in FA at any given position, so teams have been prepared to pay relatively big $ (unwisely) to guys who’ve had previous success but whose values have been depressed by one or two poor years, hoping to catch lightning in a bottle (see: Gagne, Eric, 2008, Renteria, Edgar, 2009). It’d be interesting to see the spread of the players who have been badly overvalued in the FA market in the last few years – I bet that a good % of the contracts will be of this type (although there’ll surely be plenty of plain bad contracts of the Carlos Silva variety out there – presumably these’ll become more scarce as the bad GMs get progressively removed from baseball).

by Felonius_Monk on Feb 19, 2009 5:07 AM EST reply actions   0 recs

further thoughts...

I guess it’s also possible that this disparity somehow represents the fact that, previously, GMs have severely undervalued defense in a lot of cases. Again, it’d be interesting to look at the division of runs-above-replacement for the two groups of position players (the <1WAR group and the >1WAR group) and see if maybe there’s a defensive disparity there. Could be that a higher % of the <1WAR guys are poor defenders being overpaid for their good offense (whilst giving most of those runs back in the field). It’d certainly be one hypothesis to explain the disparity, though I doubt that it’s actually the reason behind most of it…

by Felonius_Monk on Feb 19, 2009 5:13 AM EST reply actions   0 recs

to further that hypothesis

it could very well be that the current WAR methodology OVERVALUES defense. Or values it correctly in magnitude, but errs in implementation, and “typical GM’s” have access to better information than we do to make decisions with.

"If I'm right, it was a brilliant move, if I'm wrong, it was a crazy idea". -Mo

by SleepyCA on Feb 19, 2009 3:20 PM EST up reply actions   0 recs

Hard to say

as many of the <1 WAR guys are relief pitchers. Most of the rest are guys that don’t play full time or are nearing the end of their careers.

There aren’t a lot of full-time players to compare at most positions, but if you look at corner OFs the highest $/WAR out there are for Dunn, Ibanez, and Abreu. That says to me that GMs don’t value defense the same as WAR – not sure who is right. Or it could be that Amaro and Bowden are both BSI. If you look at SS you will see that the two best defenders in the group, Izturis and Punto, signed for less than half the $/WAR of the more offensive minded guys in Furcal, Renteria, and FLopez.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 3:49 PM EST up reply actions   0 recs

Also, I'd like to continue fighting against the fact that spending $9MM on a 2 WAR player is a good move.

$4.5MM per marginal win is a huge cost, $2MM more than the league average of $2.5MM and WAY more than cost-controlled players make (nothing for pre-arb, and $1.3MM, $2.7MM and $3.6MM for 1st, 2nd, and 3rd year arb players, respectively).

So, given that you’re spending money on free agent, you should look to spend no more than $4.5MM per WAR. But if at all possible, don’t spend money on free agents. Sure, if the team’s going to compete and has a glarying hole somewhere, it might be worth it. But otherwise, invest the money in drafts, contract extensions for young players, and the occasional underrated free agent.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 19, 2009 9:28 AM EST reply actions   0 recs

The only way it really makes a lot of sense to dip into the FA market

is if the marginal wins you are buying put you into the postseason. It will be interesting to see how that works out for the Mets as they dropped $9.2M per WAR on Oliver Perez and $6.8M per WAR on K-Rod.

Sky, do you have an opinion on whether relievers are undervalued by WAR or overvalued by organizations?

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 9:57 AM EST up reply actions   0 recs

Probably a little of both

A relievers ability to get out of jams is often understated by WAR, but closers are way overpaid compared to middle relievers who could do the same exact job, see the Chad Qualls for Jose Valverde trade.

vivaelbeñsheets

by vivaelpujols on Feb 19, 2009 11:20 AM EST up reply actions   0 recs

Relievers as a whole are probably overrated.

Stud relievers are probably properly rated or perhaps a bit underrated.

Relievers with saves totals are overrated.

Good relievers without saves totals are underrated.

Relievers with good ERAs are overrated.

Relievers with good FIPs are underrated.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 19, 2009 1:17 PM EST up reply actions   0 recs

Its an auction. You think they should have dropped out of the bidding because of your calculations based on FIP and WAR?

Beyond the considerations of forecasting power, they may have considerations that you didn’t include in your formula.

by ol Pete on Feb 20, 2009 9:45 AM EST up reply actions   0 recs

Again, its an auction. Market value is what a buyer will pay. If you don’t want to answer whether you think the team should have dropped out of the bidding based on your criterion, that’s fine.

by ol Pete on Feb 20, 2009 3:10 PM EST up reply actions   0 recs

to the extent that we can create a universal measure of value, it's a

worthwhile exercise, because teams work with finite budgets and money spent in one place can’t be spent in another. it’s a way of trying to measure the relationship between two players who may play very different positions.

nobody is saying that every team should only pay the calculated value of a particular player and nothing more. in many cases, it may make sense to overbid on a particularly needed player when other roles are already well-filled with cheap players. so, if i have a rotation full of young cost-controlled starters and I have a great set of position players but I really need a top-notch catcher. Maybe it makes sense for my purposes to pay above and beyond what this metric says joe mauer is worth when he becomes a FA — because money spent at catcher really wasn’t going to be used to improve the team elsewhere. that makes sense, in that context.

sky didn’t say “you should only ever pay $4m per one win above average. paying $6m for a win above average is stupid.” there aren’t hard-and-fast rules like that because each situation is different.

by tom s. on Feb 20, 2009 3:41 PM EST up reply actions   0 recs

I love your intro graph.

by ol Pete on Feb 20, 2009 4:08 PM EST up reply actions   0 recs

Estimated free agent value is obviously context-independent, and obviously context matters.

To a high-payroll team like the Mets, without any sort of stud reliever, I would guess the extra money is worth it, yes.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 20, 2009 8:39 PM EST up reply actions   0 recs

it's actually not really an auction

At least not an ebay-style auction. I guess it may be somewhat akin to a blind bid auction, with an arbitrary and invisible reserve, except that the guy selling the article can lie about what bids he’s received until he gets one he likes…

"If I'm right, it was a brilliant move, if I'm wrong, it was a crazy idea". -Mo

by SleepyCA on Feb 21, 2009 12:04 AM EST up reply actions   0 recs

It’s not an auction in that players can make decisions unrelated to price, but price is the biggest driver, at least in nearly all circumstances. There are all sorts of auctions including different types on ebay.

Teams bid for the services of players.

by ol Pete on Feb 21, 2009 10:32 AM EST up reply actions   0 recs

While the market treats WAR

as a linear relationship with $$ for the most part. I still feel like there’s a market inefficiency to be had by snagging one of the few 5+ WAR players that comes on the market. Not that I have any proof but I still feel like the advantages to be had in roster construction around a single player that produces a lot versus two that produce moderately is understated.

by azruavatar on Feb 19, 2009 3:11 PM EST up reply actions   0 recs

There's certainly some of this effect.

Especially for high-payroll teams like the Yankees. You only have a certain number of positions to spend your $200MM on. And other teams really should keep a position or two open for whoever might fall to them off the scrap-heap or arrive early from the minors. Like in fantasy baseball, stars and scrubs works well because you might not know who’s going to earn $10, but spending $1 each on three guys will likely turn a profit if you don’t have to play all of them.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 19, 2009 5:01 PM EST up reply actions   0 recs

i agree

as long as that “single player that produces a lot” stays off the DL (carpenter).
the “two that produce moderately” spreads out the risk/reward.

i guess each clubs budget would drive the decision making process of risk , on a 5+ war signing.
bigger the budget, easier to absorb the risk?

by ball in play on Feb 23, 2009 9:27 AM EST up reply actions   0 recs

Another interesting aspect

of the data concerns the likelihood of a player actually performing up to his previous year’s WAR in the first year of his new contract. For both the 2008 seasons and the 2007 seasons players in the first year of new contract had lower WAR values than in their contract walk years 65% of the time.

I don’t know whether that means players tend to play better in their walk years or they tend to struggle in the first year of a new deal, but it is just one more indicator that says caveat emptor. For example, the 2006 WAR value of the 2006-07 class was $3.8M, but it you factor in the actual performance of those same players in 2007 then clubs actually paid an average of $5.3M per WAR. For the succeeding year the values jumped from $3.4M to $6.4M since the aggregate WAR of that year’s class dropped from 105 to 55.9.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 1:58 PM EST reply actions   1 recs

Footnote

During the 2008 season, 28 of 30 teams actually saw their cumulative FA investment return lower WAR values than those same players recorded in 2007.

The only two exceptions were the Rangers and the Cardinals. The Rangers return was essentially all Milton Bradley, but each of the Cardinals’ four FAs (LaRue, Miles, Iz2, Lohse) who actually played increased their WAR ranking by a cumulative total of 5.1 WAR. Thus, the Cardinals led all MLB in the cost per WAR of their 2007-08 FAs with an average of $1.5M. And that figure includes the $1.5M spent wasted on Matt Clement. Way to go, Mr. MO!

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 19, 2009 2:08 PM EST up reply actions   0 recs

At least for the Cardinals

Brian Walton did a fairly thorough analysis of walk year results for the Cardinals. It is located here:
http://thecardinalnation.com/2009/02/05/cards-walk-year-result/
Basically, he concludes that by and large, there is no improvement in walk years.

by ckeiner on Feb 19, 2009 4:48 PM EST up reply actions   0 recs

Age, changing leagues, changing time zones

There’s a lot of stuff that could effect this.

"I just wish that the late Harry Caray were still around so I could hear him mispronounce 'Kosuke Fukudome' every fukun' night" -- Dennis Miller

by fourstick on Feb 28, 2009 6:07 PM EST up reply actions   0 recs

Not sure what the factors may have been

but it doesn’t look like age. At least not in the sense that older guys are more likely to decline. In the 2007-2008 group the average age of the decliners was 33.98 years and the average age of the improvers was 34.04. In the much larger 2006-2007 group the decliners averaged 30.89 years while the improvers averaged 34.34.

Those Pilgrims ain't lookin' so proud now...

by giveml on Feb 28, 2009 10:57 PM EST up reply actions   0 recs

What I'm saying

is that as a group, you’d expect these guys to decline, given that they are almost all on the wrong side of the aging curve. This is built in to WAR$ models.

That second number is weird, but I’m having a hard time reading the data.

by haltz on Mar 1, 2009 3:17 AM EST up reply actions   0 recs

I have a basic question about "replacement level"

Does it really accurately measure, in the real world, what replacement level players do?

Does the statistical definition change year to year, depending on whether offense was up or down league wide?

And also does the presence of major leaguers who perform below replacement level indicate that what is termed replacement level is too high? In other words, does the theoretical “replacement level” player actually exist, or are there not actually not enough replacement level players to fill every major league roster?

by bailorg on Feb 19, 2009 2:49 PM EST reply actions   0 recs

Some answers.

Yes. Dave Cameron had a series on this recently at Fangraphs where he identified actual available players and found they are basically what we call replacement-level. Except for CF.

Yes, it changes year to year. Not empirically, but based on league run-environment. I’m sure it does change empirically, but the effect is too small to really notice or care about (there are enough error bars in everything else).

Even if MLB teams were really really smart and optimized there rosters, there would still be players who performed below rep level. Both because teams can be wrong about players due to incomplete knowledge of them, but also because even good players can have down years due to random variation.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 19, 2009 5:06 PM EST up reply actions   0 recs

Down years are due to random variation?

by ol Pete on Feb 20, 2009 9:51 AM EST up reply actions   0 recs

yes, sometimes. sometimes, hitters have inordinately low BABIP, for instance.

there’s an awful lot of random variation in baseball. surely, you don’t walk away from a game where albert goes 0-5 and say, man, he stinks, or, he wasn’t playing well tonight? maybe he just had bad luck.

Now, how long can bad luck go on? one night? one week? one month? I think the answer is, actually, pretty long. Enough random variation within one season might depress someone’s batting average from .300 to .280 without difficulty — that’s the difference of 12 hits over 600 AB’s. Looking at BABIP, you might be able to say, this is a player who just by dumb luck hit a few too many line drives right at players, or fewer grounders found a gap than usual, etc.

by tom s. on Feb 20, 2009 1:46 PM EST up reply actions   0 recs

You make a decent argument that random variation contributes to poor results, but that isn’t the same as attributing down years to random variation. I also wouldn’t use the phrase “playing well” in an argument that chance is the sole factor for an outcome.

by ol Pete on Feb 20, 2009 3:01 PM EST up reply actions   0 recs

no one ever said this.
chance is the sole factor for an outcome.

this is what sky keeps objecting to.

you’re transforming an argument that chance CONTRIBUTES to outcomes into one that suggests that chance IS THE SOLE FACTOR. Of course that’s stupid. Nobody thinks that CC Sabathia and Odalis Perez are only separated by the fickle finger of fate. skill plays a role.

by tom s. on Feb 20, 2009 3:46 PM EST up reply actions   0 recs

Chance was the only factor offered up and the operative phrase was

even good players can have down years due to random variation.

I’m sure all parties assume skill was a factor. I’d say the list of potential factors that contribute to down and up years is pretty long.

by ol Pete on Feb 20, 2009 4:17 PM EST up reply actions   0 recs

and i don't think he every said "good players ONLY have bad years due to

random variation."

 I’m sure if you’re saying “good players can have bad years due to injury, due to age, due to decreasing their dosage of androstenedione, due to losing their favorite binky, due to psychological distress from the cancellation of ‘Arrested Development’ . . . etc., etc.” sky would agree. well, he’d agree to most of those.

by tom s. on Feb 20, 2009 4:25 PM EST up reply actions   1 recs

There was a question mark

and here are your words:

good players can have down years due to random variation

How’s this: some players have down years due to random variation?

by ol Pete on Feb 20, 2009 3:07 PM EST up reply actions   0 recs

Yes, some players have down years due to random variation.

Some players have up years due to random variation.

Some down years are not due to random variation.

Some up years are not due to random variation.

Obviously, nothing in baseball is strictly random, but it can be effectively random. That’s actually the connection that needs to be explained better. Batting isn’t flipping coins. But hitters DO guess at pitches. A ball landing two inches beyond a fielder’s reach versus being fielding isn’t a ton of skill. Distributing ones batted balls so that they’re optimized against good/bad fielding teams isn’t totally a skill. Tweaking one’s hamstrings due to bad weather vs. having good weather isn’t a skill. Sh!t happens.

Beyond the Boxscore // Calling BJ Upton lazy is lazy.

by Sky Kalkman on Feb 20, 2009 8:43 PM EST up reply actions   0 recs

Comments For This Post Are Closed


User Tools

Welcome to the Internet's #1 St. Louis Cardinals blog.
Start posting about the Cardinals »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

1753738656_110919ebe9_o_small
2010 Hot Stove Post #1: CHONE hitter projections

Recent FanPosts

Avatar_small
How to EASILY make tables for Fanposts
Arch_small
Number 15
Small
Some thoughts on Holliday (and potential replacements)
Small
Ok let me try this again...
Knights-09_small
Disenchanted Blue Jays Fan Looking For A New Team
Painterlance_small
The Holliday Dilemma (Rocks Fan Perpsective)
375830-r1-025-11_011_small
Anybody read Bob Gibson's new book yet?
Flanders_small
Yadi2first
Small
40 Man Question..

+ New FanPost All FanPosts >


Managers

Jack_benny_small DanUpBaby

Editors

Bender1_small azruavatar

Adam1_small chuckb

Kid-a-bear_small the red baron