Rich countries and happiness: the story of a bet.

by

Do countries that are already rich become even happier when they become yet richer? This was the essential question on which I entered a gentleman’s bet in 2004 with Andrew Leigh and which just recently got settled.

The reason for the bet was a famous hypothesis in happiness research called the Easterlin hypothesis which held that happiness did not increase when rich countries became even richer. When I was preparing a presentation on this matter in 2004 I used the following graph to illustrate the happiness income relation across countries:

gruen 2004 image

This graph shows you the relation between average income (GDP in purchasing power terms) and average happiness on a 0-10 scales for many countries. As one can see, the relation between income and happiness is upward sloping for low levels of income, but becomes somewhat flat after 15,000 dollars per person. I championed the idea that this was not just true if you looked across countries, but that this would also hold true over time.

Andrew Leigh’s thinking was influenced by other data, particularly a paper by Stevenson and Wolfers which – he thinks debunks the Easterlin hypothesis. Here’s one of their graphs:

 

Wolfers2008

What’s striking about this graph is that the dotted line slopes up in the top right corner. In other words, the relationship between happiness and income becomes stronger, not weaker, for countries with average incomes over $15,000. Andrew thinks that this is because they specify income in log terms (in other words, we’re looking at the effect on happiness of a percentage increase in income rather than a dollar increase in income). I think it’s because the Gallup poll isn’t measuring happiness, but is instead asking people to rank themselves on the Cantrill ladder of life scale.

So our gentleman’s bet was in effect a bet on whether happiness in the world value surveys behaved different to the ladder question of the Gallup polls, and on whether the short-run relation between income and happiness was strong enough to show up in periods of 5 to 10 years as well. Andrew thought it would, I thought 5-10 years would be long enough for the typical long-run no-effects findings to show up and that happiness has a different relation with income than the Cantril-question. So we bet on whether one would get a significantly positive relation between GDP growth and happiness changes for the rich countries when one looked at the World Value data for 2005. We agreed to look at the relation between income and happiness using country-average variation. The winner would get 100 bucks.

Now, both of us forgot about the bet for a few years as the data was supposed to become available. Only recently did Andrew remind me of our bet and asked to check what had happened.

When I (with research assistance from Debayan Pakrashi) started to look into this data again, it quickly became apparent that Andrew and I had been pretty sloppy in formulating the precise conditions of the bet. In many ways, our bet had been far too vague.

For one, the World Value survey is not in fact held in particular years. Rather, some survey is run almost every year in some country that adds to the collection of surveys known as the World Value Survey. Hence there was really no such thing as a ‘2005 wave’. Taken literally, only Australia, Finland, and Japan had a survey in 2005 and were countries that in the previous wave already had a GDP of 15,000 dollars. In all those countries, income had gone up a lot since their previous survey, with Australian happiness down and Japanese and Finnish happiness up. That is a bit meagre as ‘waves’ go.

So the first ‘addition’ was to have a bandwidth of years for the ‘2005’ waves that included 2004, 2005, 2006, 2007, and 2008. That gave 12 countries that were rich enough in the previous wave to qualify. The raw data was:

Table1_2013

The next ‘snag’ was of course that there are many ways to define the dependence on income: linear or logarithmic. With logarithmic income one normally gets stronger statistical significance on income, so we went for logarithms.

Then, of course, there are still many other things one can put into the regression. Does one account for effects of particular years (in bands) and for the level of happiness that a country starts? We decided to try it all. Hence the final ‘deciding’ set of regressions were as follows:

 

Table4_2013

Which tells you that the relation between income changes and happiness changes (the last two columns) was either quite insignificantly positive or even negative if one entered year-bands.

When one reflects on the list of countries used in the analysis though, it is clear that the outcome of the bet will have had little to do with the true relation between income and happiness. It will have hinged on hidden aspects of the data. For instance, the Australian world value survey in 1995 was run differently from the 2005 version. Hence the big drop in Australian happiness you see in this period for this data does in fact not show up for other Australian data (like the HILDA). So one suspects some change in the data-gathering to be responsible for it. Indeed, the level of Australian happiness in this data is markedly below the level found for the HILDA (where it is almost 8.0).

Similarly, the big increase in Japanese happiness in this period doesn’t show up either in other Japanese data and so probably has something to do with changes in how the survey was run there. The changes can relate to the months in which the surveys were held, the precise words used for the happiness question, the questions preceding the happiness questions, the cities in which the survey was run, how the survey was run (face-to-face or via telephone), etc.

So I may have gotten lucky and won the bet, but one cannot see the outcome as decisive evidence that income and happiness have no long-run relation within rich countries. The data for the 2010 post-GFC wave might well show the opposite!

5 Responses to "Rich countries and happiness: the story of a bet."
  1. Great story Paul – Really begs the essential question of what happiness is (that we assume people maximize).

    Not too familiar with “happiness” measures – I wonder if “Life satisfaction” may capture more primitive levels of happiness, such as my kids surviving until adulthood, being able to work, not suffering from lifetime ailments, being able to have some leisure time, occasional celebrations, etc., whereas the happiness that is gained from moving up from moderate wealth to greater riches reflects degrees off the life satisfaction scale (e.g., longer vacations, early retirement, better health in retirement, higher quality leisure, more time for friends, etc.).

    Why only 100 bucks, I think a $100,000+ wager would have convinced me of your (1) prior convictions, (2) confidence in the conclusions that you thought you could have drawn from the data, and (3) risk seeking nature!

    • hahahaha. You dont want to put too much money onto these bets. A token amount that buys you enough wine for a party is perfect. Otherwise you would end up with endless debates on which purchasing power parity series to use, whether or not one needs adjustments to happiness, etc. It takes the joy out of such things!
      Thanks!

  2. Dear Paul,
    I think you’ve hit the nail on the head when you suggest that measurement issues mean there’s no possibility of “decisive evidence” one way or the other. But I believe this is the very key that unlocks the answer, revealing who won the bet!
    Wealth is statistically (and precisely) measurable: happiness isn’t. Therefore it’s not possible to attempt to directly compare the two concepts; no matter how many (apparently significant) measurements seem to suggest a correlation. Perhaps examining ‘health’ might provide a more robust relationship – or suicide rates. Both Australia and Japan score pretty well in these fields, too . . .
    As you’re also aware, income distribution within a given society is also being ignored. I suspect this may also have an affect on perceptions of ‘happiness’.
    I’d leave you with Lady Di’s quote. In an extremely mournful tone she told the interviewer, “Yes, I suppose I’m happy . . . whatever that may be”.
    Regards,
    Nic Stuart

  3. I believe that the distinction between happiness and life satisfaction is absolutely critical here – Amartya Sen’s ‘Development as Freedom’ is the essential treatise on this, where essentially happiness is a transitory emotion (which, once basic needs are met, tends to trend as you’ve illustrated in your first graph), where as satisfaction is more in line with Sen’s concept of ‘capability functionings’ – in layman’s terms, the ‘capacity for choice’, the ability to determine one’s own future, with the more control one has the more one is – on average – satisfied.

%d bloggers like this:
PageLines