Insiders vs outsiders
Government departments are constantly criticised for their lavish spending on outside consultants. Why, the newspapers ask, couldn’t they rely on the inside talent that taxpayers are already forking out for. This paper, mentioned by Eliezer Yudkowsky may give some clue. It turns out that people are not only incredibly bad at predicting how long it will take them to complete a task, they also get worse at predicting it as they know more about it.
A person who knows the ins and outs of a project will estimate the completion time of the project by taking in to account all of the things that they know need to be done for that particular project. In doing so they tend to disregard all of the unforseen stuff-ups that could happen along the way. An outsider will tend to estimate completion time by looking at how long similar projects have atken in the past. It turns out that the latter approach is not only far more accurate, but also estimates completion times far, far longer than ever predicted by insiders.
Could it be that, in some cases, ministries are actually saving us money by getting an outside perspective on a project? Quite conceivably, the money spent hiring the consultant improves project planning to the point that less money will be wasted on false expectations of the project’s success. We should also disregard the protestations of the ministry insiders that the hiring of the consultant was a waste of money because the consultants know very little about the project. It is precisely because they are not involved in the micro-management of the project that they can provide a realistic estimate of the project’s expected success and completion time. Of course, advocating more government spending on consultants is hardly an election winning strategy.
I agree with these points, but I think there is also another reason why contracting to outsiders can be a good idea.
When you offer a contract on open tender you force consultants to compete to get the contract. They are willing to undercut each other on price and offer to do the job as quickly as possible. If the project was performed in house, there would be no competitive bargaining process, the employee is the monopoly provider. In this case the employee extracts some surplus by taking longer than is efficient to do the project.
In a sense we have an agency problem. The government employees know that their effort is not observable, so take longer to finish a project. By hiring consultants you get past this agency problem, as they are forced to join a competitive market to get the project in the first place.
That’s probably true. I’d like to know whether consultants’ estimates of their completion date are any more accurate than employees’ estimates. I wonder if the competition to estimate quicker completion and lower costs increases the optimism of their estimates and thus makes them even more inaccurate than insiders’ estimates.
Consultants have to have the project finished by there estimate though, or they get a bad reputation. At my work consultants would rather work weekends than miss a deadline. I don’t think that government departments engender that kind of urgency 😉