How to encourage social science academics to work on Australian policy?

by

In recent years, there have been many reforms to the incentive system that social science academics (those in the fields of economics, finance, psychology, management, health, marketing, etc.) live under in Australia. There was the Research Quality Framework, then the ERA, and now something based on expert panels that is perhaps closer to the ERA in Britain. There have also been fluctuations in the amount of money pumped out to academics via the ARC, the NHMRC, local state funding, and many direct research outfits (like CSIRO). I first want to make some observations on the changed incentives for academics, before going into actual recommendation as to how we could get our top academics to do more work on Australian policy matters. In short, if you want more of the top academics to write on Australian policy issues, I would recommend setting up specialised PhD institutes like the European Institutes, and I would recommend a more relaxed attitude to privacy when it comes to the use of Australian datasets by academics.

Observations:

1.       At the top end, it has been publish or perish long before the government got into the game of assessment exercises. Good young budding academics knew that in order to be seen as a top academic they had to do well in the international publication game. Like it or loathe it, that game is dominated by Europeans and Americans. This doesn’t mean that it is impossible to do work on Australian issues and get into the top journals, but it does mean that one ultimately has to work on the things that interest European and American editors and referees. Hence a cute Australian experiment with a policy that might also be introduced elsewhere (say, the baby bonus or HECS) has a shot. An analysis of the labour market dynamics in Australia has no chance. As a result, many of the top academics have told their best students in the last 30 years or so not to work with Australian data and to preferably go and study somewhere else. It is a form of cultural cringe in that one has an insufficient degree of pride in ones’ own country, but many felt this was the honest advice they owed their students. Australia is not alone in this. We interviewed job market candidates from Britain this year whose supervisor had told all his students to work with American data in order to have more chance of top publications.

2.       The research assessment exercises have made the reality above visible to everyone. In particular, it has made it visible who has not played the international game at all and who has. Even though it was only in place shortly, it has lead to major changes in the power structure inside academic schools, and now that that genie is out of the bottle it wont go back in. Those who publish a lot in leading journals were promoted much faster than they would have been otherwise, whilst those who didn’t do any visible research had to become administrators if they still wanted to have a chance of being called professor. This was both good and bad. It was good for the highly talented who felt frustrated that there was no clear way in which they could outperform others, whilst it also, at a stroke, stigmatised individuals who made different, but still worthy, investments, such as in teaching quality or local research groups oriented towards Australian policy. At a stroke they were visibly designated as second rate, whereas before they could at least with some probability get away with saying they were world-class (which, in a local sense, they were). The recent demise of the ERA changes nothing about this reality, so don’t expect any tweaked version of the ERA to make much difference. The real losers from the recent change in the ERA are those who only look good on an A/A* publication schedule, but whose work is not cited, who have few grants, who teach small classes, who do little service, and who basically play no other game than the international publication game. And they do not really lose any of their reputation, but their desirability for institutions looking to do well in ERA rankings is slightly reduced, which might cost them some of their loadings.

3.       Even though teaching is the core business of the tertiary sector, the assessment exercises have contributed to the gradual marginalisation of teaching that has happened the last 20 years. Teaching in academia is now considered a second-rate activity, one that is actively avoided by the up-and-coming. In fact, the reduction in the status  of teaching in academia has gone so far that teachers are now at the very bottom of the university hierarchy, behind administrators who can boss them around and pester them with forms; behind junior researchers who know nothing about real life but who play the journal game better; and even behind contract workers. It is no wonder that the academic teaching profession is not attracting good youngsters and has to rely heavily on migrants who will by design know less about Australian policy issues and will have less interest in it.

4.       The advent of the internet has increased the possibilities of academics to move into the market for Australian economic issues. Blogs, tweets, homepages, and virtual centers have reduced the costs of speaking to the general public and to the policy makers. This has made the returns to Australian policy work more direct and higher, though paradoxically it tends to reward fairly shallow commentary rather than real understanding (I say this as a blogger). This trend is still continuing.

5.       The government bureaucracy has had an increasing appetite for academic involvement. Hence there has been an explosion of groups loosely affiliated with universities that essentially do work for the ministries. They write reports on poverty, Aboriginal issues, health, urbanisation, transport, tourism, etc. They evaluate proposals by industry and other ministries. They set up courses for the bureaucracy and in almost every other way provide intellectual services to ministries that seem to treat academia as a substitute for in-house expert knowledge.

In short, it has been a mixed bag for the incentives to do work on Australian policy. At the top research end, all the incentives are not to bother and the best students who could be interested in it are actively dissuaded from pursuing Australian issues. At the bottom teaching end, the reduced status of teaching has lead to a large reduction in the amount of local content that will be taught to the next generation, just by virtue of who teaches it. But elsewhere, work on Australian issues has blossomed like never before. There are thus more than enough report-writers, too few teachers, and  perhaps too few top academics involved in Australian economic and social policy issues.

The problem at the teaching side is basically unsolvable. You would have to double academic teaching salaries to make a dent on their low status and such a move, whilst not actually that expensive, will be bitterly resisted by everyone else (i.e. the researchers and the administrators) because it would lower their relative standing. They would most certainly veto any change or pervert it so that it first increases their salaries. Even if one is capable of bypassing all the forces rallied against increases in teacher pay, it would take decades for the higher incentives to be an academic teacher to work through into more home-oriented teachers to enter the system. The best you can probably do in the short-run is to have additional courses on local content for the civil service, which is a market that already exists and seems to be working quite smoothly.

Presuming that one sees it as a problem that our best minds are turned away from internal issues (though of course you have the odd exception of someone so interested in local issues that they are prepared to accept a hit to their academic standing), the question is what can be done. The following possible actions come to mind:

1.       Set up a world-beating PhD education system. Australia has enough smart academics to teach at world-standards in almost any field of social science, but individual universities do not have the clout to offer their PhD students something comparable to overseas PhD places, like the European Institutes, or the Ivy league programs in the US. This means that many of our best young minds are sent overseas and don’t come back, whilst it is the home-grown young minds that are far more likely to be interested in Australian policy than the imported academics. Thus, effectively, the lack of world-class PhD programs prevents our best minds from working on Australian issues. We can set up such institutes, again at a cost that is not too great. What has worked for the Europeans is to have a dedicated PhD institute with an academic governance structure that limits the time any individual academic spends at such a place. Hence what one needs is a European Institute type scenario where one has dedicated PhD programs, located in one of Australia’s major cities.

2.       Open up the data files. It has been said many times before but it clearly needs to be said many times again: Australia actually collects great databases. Good enough so that their use could interest international researchers. However, the ABS is too afraid of the privacy laws to make it easy for academics to use them. I for instance know of a recent case where someone had to wait 18 months to get information on whether respondents to a particular survey lived in NSW or Victoria. By the time the permission came, the researcher involved had already left! The reality of international research is that one looks for low-effort, high-gain data, and the barriers put in place to use the Australian datasets are simply too high to bother. This is in a sense a ridiculous state of affairs because it means that Australian tax payers fund large datasets which are not used whilst they also fund researchers who work on American and European datasets! There is an easy solution, and it is to be much less prissy about privacy concerns. Abuses of data virtually never happen and you can punish people afterward anyway. Yet, the ABS still does not bring out data that links individual information to their medical records, their military records, their employment and tax records, etc. It has the technical know-how to do it, but thinks it is shackled by privacy concerns. A most inefficient state of affairs that is a big turn-off for academic researchers who play the international game.

3.       Do not introduce specific measurement devices for policy impact because a poor measurement instrument is worse than no measurement at all: for academics, the main reason to be interested in local policies is because one wants to make a difference. Media attention, policy impact, ego, etc. As soon as you start directly rewarding any observable impact though (which is only very loosely related to real impact), you will create a wall of noise because the market for policy advice will be flooded by academics who want to crank up their ‘policy ratings’. Institutes will specialise in targeting particular bureaucrats with their publications in the hope of being cited. Middle-range junior academics will start to nit-pick with policy reports in order to get a mention in the next one. Blogs, tweets, and websites will flood the market such that no-one will have much clue what is useful and what is not. As a result, the marginal rewards to policy work will actually reduce for the good academics who will then simply no longer bother. Australia has already had experience with this kind of perverse effect, which is really just a standard effect that occurs when you replace a market mechanism by imperfect bureaucratic measurement: the ‘DEST’ system for measuring productivity. Under the DEST system, every publication and every conference started to count as ‘output’. As a result, Australia witnessed an explosion in fake conferences, conference volumes, local academic journals, etc. The ‘publications’ in those conferences and journals all counted towards DEST and hence they were a way to prop up the CV’s. As a result though, many academics stopped coming to the local conferences and no longer sent anything to local journals, simply because it was no longer worth their while and started to be a bad signal. And one can even argue that the ‘productivity explosion’ engendered by the DEST formula was worse than worthless in that it diverted effort away from more worthwhile things to do (including leisure time with the family). Hence, let the bureaucracy and the politicians work out themselves which academics they want to contact about policy work (academics don’t get paid so much that they will really say no if offered the right price), and don’t mess that market up by inept measurement because that is worse than no measurement.

10 Responses to "How to encourage social science academics to work on Australian policy?"
  1. Paul,

    I think it’s important to point that innovative policy work of interest to Australia is often published in top journals. But the hurdle is innovation (which I guess you call “cute”).  

    For example adding to HECS, we have

    http://www.jstor.org/stable/2235066
    The Collapse of the Australian Wool Reserve Price Scheme.

    And many many such example more papers.  Including more recent examples.

    Papers that have little innovation but that are of interest  to demographers indeed are difficult to publish in leading global journals.

     

  2. Rabee, are you seriously going to argue with me that you dont have to jump a higher hurdle with Australian data at the top journals?
    I seem to remember the story of a then-young professor of economics telling a congregation of newly minted PhDs a few years back that if they were serious about their career, that they should go to America and work on American data…..
    Indeed, I believe that same now-older professor agreed with John Quiggin not more than a week ago that the ERA as it was was leading to higher incentives to follow the Americans and Europeans….
    To re-issue an old phrase, Rabee: wipe your mouth, there is something very dirty still clinging to its side!

  3. Paul, 

    I don’t think that there is a field of research called publishing papers with Australian data.

    There is economic research for a global scientific audience and perhaps economic research that is generally local policy oriented for a local audience.

    The former in my view can be published in journals with a global audience if it is good enough. The former can have a policy focus. 

    It’s not about the data that one uses, but about the audience that one has in mind. If one writes science for scientists, then scientists are happy to accept their work in scientific journals. 

    There is a difference between who one is writing the paper for and the geographic source of the data. 

    Looking around at the tremendous achievements of our junior colleagues.  We see experimental work done with Australian students, labour work done with Australian data, macro simulations with Australian data published in top journals. Your own recent work using Brisbane data is aimed at top journals. 

    It’s the audience one has in mind that matters and not the data source. 

    The advice that is persistent in all of this, advice for junior colleagues is write for a global audience, write science for scientists. 

  4. I think you are wrong Rabee. There is certainly a higher bar for papers using using Australian data. Indeed, you admitted it yourself by saying that the test was innovation, because the test is broader for papers using US data. On average, a paper using Australian (and only Australian) data has to be more innovative than a paper using only US data, because there isn’t the same general interest. Whether setting up an EUI type of institution here would change things measurably, I’m not sure. My experience is that many of the top young potential PhD students in Australia crave international recognition and exposure and make their choices accordingly.

  5. Nice to meet you LO

    It is perhaps more difficult for all Australian based academics to publish works in good journals than for senior scholars in the top international schools.

    We all have to walk the extra mile in terms of innovation.

    I don’t think that an Australian based scholar will have an easier time passing the innovation test in a top journal if she uses Australian or indonisian or american data. It’s simply very hard to publish in any top journal in any field for us. One reason is that giving regular seminars internationally is difficult for Australian based academics

    Though I have to say I’m told that the innovation hurdle is just as high even for Chicago labor professors.

  6. Labor is probably the single biggest field in Australia. Perhaps this also explains the observations Paul has made, particularly in conjunction with the fact these skills are in such high demand globally.

  7. I took advice to get trained overseas, but it was mainly because of the large gap between policy relevance and what top researchers are working on here. This also means that the most policy relevant work available in Australian universities appears to be to teach. But as Paul has pointed out, the rewards are very low. I prefer to be bossed around by admin people working in or for government, where the work is actually policy relevant. Others like me would be far less likely to go overseas for training (and in the case of other, very good students, then never return) if there was a stronger PhD education system. Perhaps a PhD system not solely aimed academic researchers could provide an installed base to grow a more broad based ‘world beating’ system Paul is proposing?

  8. LO, Craig,
     
    yes, its interesting to think of what a top-class PhD program would look like if you had an institute (say, in Sydney) that had enough funds to get top people to teach.
    I think it should depend on demand what would be taught at such a place. If the demand from the good students and their home universities would be to teach a basic academic package then that is what should be offered. If there is sufficient demand for topics like advanced public finance or Australian Policy issues, then one can try and offer something like that too. My guess would be that the initial market would be mainly for a standard academic package with relatively little local content, but if Craig represents a large group….
    LO, I think that the lure of the US and Europe is waning fast. Australia already seems to have overtaken the US in terms of GDP per capita and whilst Europe and the US will struggle for years to come with squeezed university budgets, there appears little slack in the strong demand for Australian universities. Also, if you think of the basic resources that inner-city Australian universities are sitting on, it is almost unparalleled: great living conditions (climate, atmosphere, amenities), competitive pay, good top undergrads, plenty of conferences and visitors, huge basic surpluses.  What we need to keep the best students is to offer them something that is as good as they could get abroad.

  9. Really Paul, you think the allure of the US for top econ students is waning? You must be talking to different people to me! While you are right that US and EU universities face more severe budget constraints in the future, the top US universities are still, overall, much better funded than the top Australian universities, with, on average, a much higher calibre of researcher. I don’t think Harvard is having any trouble attracting top students. And setting aside differences in content and rigour, there is also the signaling value of an overseas qualification, especially for Australians that want to spend some of their careers overseas. There are of course some exceptional people in Australian universities, but the labour market is thinner overall, and it remains much easier to get into a top Australian PhD program than a top US program. Perhaps that could change with a restructuring of the sector (including a liberalisation of fees) but it seems some way off to me.

  10. LO,
     
    I know what you are saying, but I really think the gap can be bridged. In some ways, we are already ahead: the American top universities are often in thoroughly forgetful places, unlike the inner-city campuses in Oz. That matters for people with kids and anyone interested in a life outside study. The weather and general atmosphere is also much more enjoyable here. Hence there is already a natural advantage.
    I think the funding argument is highly exaggerated. If you look at the block funding for instance that the ANU gets for the IAS (250 million each year), then that is equivalent to a 5% net return on a 5-billion dollar endowment. That leaves many top universities in America lagging behind. Individual states similarly give the universities big hand-outs in this country, and the real estate value of the inner-city universities is staggering (indeed, if places like Melbourne or UWA were truly run for profit, they would kick out the students and sell the land).
    The other barriers you mention seem a question of will, not of underlying resources.

%d bloggers like this:
PageLines