When "The Weight of Empirical Evidence" Is Only "Anecdotal or Theoretical":

In a post on proposals to raise the minimum wage, Kevin Drum comments:

"it's worth noting that virtually all the evidence on the anti-minimum wage side is either anecdotal or theoretical. The evidence on the pro-minimum wage side is concrete and statistical."

Yet the very story he cites as the basis for this proposition reports otherwise.

In a new report, economists David Neumark of the University of California at Irvine and William Wascher of the Federal Reserve Board say a review of more than 90 studies in more than 15 countries since the early 1990s shows nearly two-thirds of the studies find a "consistent" though not always statistically significant negative impact on employment. Fewer than 10 found a consistently positive impact. While there's "no consensus," they say, "the weight of empirical evidence" supports the traditional view.

UPDATE: I am not sure, but this appears to be the Neumark-Wascher study referred to in the WSJ story. From the conclusion:

In general, our results provide evidence that minimum wages tend to reduce employment rates among the youth population. A clear negative correlation between the level of the minimum wage and youth employment-to-population ratios appears both in the raw data, and in time-series cross-section regressions relating employment rates to minimum wages, with controls for overall economic conditions and cross-country variation in labor market policies and institutions. The disemployment effects also appear in models that control for country-specific factors (including country-specific time trends), indicating that the results are not solely driven by cross-country differences in minimum wage levels and youth employment rates.

Related Posts (on one page):

  1. When "The Weight of Empirical Evidence" Is Only "Anecdotal or Theoretical":
  2. Worker Privacy and Ohio's Issue 2:
go vols (mail):
Let me get this straight.

2/3rds of these studies show a "consistent though not always statistically significant negative impact." How many of these 2/3rds pass some test of significance? That they didn't say doesn't bode well. Moreover, there's no mention of how substantial the effects are. "Significance" alone doesn't tell you much, if you don't describe the magnitude of the effects.

I'm not sure how they derive "the weight of the evidence" from such results, but I bet that Professor Bernstein's version of Daubert wouldn't let it slide if we were talking about a relationship between some alleged toxic substance and a series of civil torts. As someone skeptical of the mantra that "raising the minimum wage eliminates jobs," I don't think one gets very far with this argument.
11.3.2006 3:25pm
Thorley Winston (mail) (www):
I think that this is the study that the article is referring to.
11.3.2006 3:43pm
John T (mail):
I'm not sure how they derive "the weight of the evidence" from such results, but I bet that Professor Bernstein's version of Daubert wouldn't let it slide if we were talking about a relationship between some alleged toxic substance and a series of civil torts.

You mean like, for example, secondhand smoke? Since that's exactly what studies of secondhand smoke consistently show-- the vast majority of studies show a nonsignificant effect, but some level of negative effect.

Of course, studying the minimum wage is always difficult. It wouldn't entirely surprise me if a higher minimum wage didn't cost jobs-- mostly by causing suburban kids from well-off families to look for part-time jobs, and other people with fairly decent skills and attitudes to put off additional education in favor of working now. Both groups of people could have enough job skills and aptitude to justify the higher wages. Of course, it would hurt the worst off among us, who wouldn't have the skills to justify the higher wages, and who would be outcompeted by the new entrants.

I can't see the benefit of a policy that takes jobs from poor people in the inner city and gives them to suburban teenagers, even if it doesn't cost net jobs.
11.3.2006 4:14pm
Gino:
go vols -- I believe "significant" means statistically significant. Statistical significance has a precise meaning in statistics. I'm no statistian, but I believe it means that the results (whatever they are) are outside the known margin for error. In other words, the results are statistically "significant" if they cannot be dismissed because they fall within the margin for error. Perhaps someone can explain it better (or correctly if I'm mistaken).
11.3.2006 4:32pm
chrismn (mail):
It does mean something when lots of studies all find that an effect goes one way, but none of them individually find the effect to be statistically significant. This is what meta-studies are all about. If one sees that X "causes" Y to go up 3%, but this is not statistically significant, that means that given the sample size, one could not rule out with 95% certainty that the effect you saw was due to sampling error. But if you see 5 studies all which show around the same thing, this is like increasing the sample size. If there really was no effect of X on Y, what would be the probability of the sampling error always going in the same direction? So the fact that most studies show a non-statistically significant effect of an increase in the minimum wage in the same direction (it decreases employment, especially of the young) means that you can be pretty confident that the effect is real.
11.3.2006 5:45pm
Elliot Reed:
I don't think this supports the anti-minimum wage view. If anything, what it suggests is that the negative effect probably exists and is extremely small. While it is logically possible to take the view that any negative impact on employment is a sufficient reason to oppose the minimum wage, I've never seen any evidence that anyone actually holds this position. Rather, the fact that effect appears to be miniscule supports the view that the widespread benefits of the minimum wage outweigh the harm imposed on an extremely small number of people.
11.3.2006 5:47pm
Alan Gunn (mail):
What are the "widespread benefits" of the minimum wage? One reason why many people, including me, oppose minimum wage legislation is that few of its beneficiaries are poor. A study a few years ago showed that the median income of households with a minimum-wage worker was about $60,000. More basically, though, what's the argument for funding wage increases for some low-wage workers by what amounts to a tax on people who employ low-wage workers? The earned-income tax credit gives low-wage workers a pay increase funded by those who pay income taxes, it's targeted at those who support families, and it has no adverse employment effects at all. So why is an increase in the minimum wage better than an increase in the EITC?
11.3.2006 5:59pm
Andy Freeman (mail):
> I believe it means that the results (whatever they are) are outside the known margin for error.

It means that the results are unlikely to be the results of chance.

However, if you run the experiment enough times, you're going to get results that are "wrong". And, if you select the experiments that you report "correctly", you can even generate a consensus or bias a meta-study.
11.3.2006 5:59pm
Houston Lawyer:
Surely the theory that a too-high minimum wage will affect the creation of entry-level jobs is correct. Otherwise, there would be no reason not to require every job to pay at least $20 per hour.

We have the same issue with the Laffer Curve. The only question is where we are on the curve, not whether the theory is sound.
11.3.2006 6:35pm
gab (mail):
I agree with Houston lawyer. If the minimum wage is currently below the equilibrium level where wages and employment "clear", then raising the minimum wage will not have a negative effect on employment, and vice-versa.

This level most likely varies from one geographic region to another, thus making minimum wage issues best dealt with at a local level.
11.3.2006 7:04pm
CLS (mail) (www):
These would be studies of actual changes in the minimum-wage. So how significant an impact they would have would depend on the conditions at the time. But the impact would be negative in all cases as common supply/demand curves would show.

Here are two cases. In one assume the average wage paid is $10 per hour and the minimum is $2 per hour. But you find that almost no one is paid $2 per hour, in fact 99% of all workers get over $3 per hour. So they raise the minimum from $2 to $3. A few workers earning $2 per hour lose their jobs. Not enough to make a statistical difference in general though I suspect it would be significant to them. A mild increase when wages are generally well above the new minimum will have almost no negative impact. But then it will have no positive impact either -- in the sense of raising the wages of many people.

On the other hand assume the same scenario but you raise the minimum to $8.00. In that case you would see severe impact. The only way to mitigate the negative impact of minimum wage is to raise it such a way that very, very few workers are actually effected either way.

Now what would a minimum wage that “works” do. It would raise the income of some workers in a meaningful way. But at the same time it would have to price other workers out of the market.

What is statistically insignificant is only insignificant because it had no impact on most people. So the general result is insignificant. On the few priced out of the market the result is very significant indeed.
11.3.2006 7:49pm
Justin (mail):
CLS, you're assuming that the market for low-income wages is perfectly competitive in an Econ 101 sense, which it is of course not. Though empirical economics is useful, the use of theoretical economics, at basic level (with the possible exception of Bain and Nash economics), will only randomly get correct results.
11.3.2006 8:52pm
godfodder (mail):
Basic logic mandates that minimum wage is inversely related to employement among affected workers. It's airtight. You raise the cost of labor and employers will be reluctant hire more people. Yes, it is stunningly simple, but so is basic arithmetic-- doesn't make it wrong!

The countervailing argument is that minimum wage hikes "put more money in the pockets of workers," and thus stimulate demand, which eventually results in employers hiring. Sorry, but that has always seemed too clever by half, and completely unconvincing. For example, what if workers saved the extra income? Goodbye demand!

Actually, I don't think that most advocates of higher minimum wages care about the employment effects. To them it is more about "fairness" than anything else. They want to help the "downtrodded," and wage hikes seem to be a convenient method. Also, it is much easier to self-righteously demagogue wages than to talk about abstract, downstream effects.
11.3.2006 11:54pm
American Psikhushka (mail) (www):
No one seems to be discussing the inflation that results from increasing the minimum wage, which effects everyone. The poor and those on a fixed-income most of all. But I guess since they're inflating away in general this gets lost in the shuffle.

And if the minimum wage is below the market-clearing rate why raise it? The only reason to do so is political - so someone can act like they're helping the poor when they're hurting them. Because even if the minimum wage is below the market clearing rate there is still the possibility of jobs being created at that level and those are lost. That's what's so frustrating about this issue - the people who actually trying to help the poor sound heartless.
11.4.2006 9:24am
Sasha Volokh (mail) (www):
Elliot Reed: You said: "While it is logically possible to take the view that any negative impact on employment is a sufficient reason to oppose the minimum wage, I've never seen any evidence that anyone actually holds this position."

You've never seen any evidence that anyone actually holds this position? Well, now you know of one person.
11.4.2006 10:47am
godfodder (mail):
Actually, the solution to this "problem" is simple. Since the government is setting the wages for workers, not the market, then just have the government mandate that business has to hire/employ "X" number of workers. That way the government can offset any supposed loss of jobs due to raising the minimum wage!

In fact, the government can just regulate us to any unemployment rate they desire. 4.3% for as far as the eye can see! Then hike the wages, which hikes the taxes, and voila! A balanced budget for as far as the eye can see!

Hey, this regulating yourself into prosperity thing might just get addictive.
11.5.2006 2:18am
Not a lawyer but ...:
No, Kevin Drum didn't write a post on proposals to raise the minimum wage. He wrote about one article in the WSJ concerning what happened in Oregon: read it again. The "evidence" he talks about is ONLY what is in THAT article.

Kevin HAS written about the minimum wage in more depth than his commentary on one WSJ article: in June 2006, for example. Here's what he said then: At this point, the bulk of the evidence suggests that modest minimum wage increases (a) provide a measurable benefit for poor workers, (b) have little or no impact on employment levels, and (c) are paid for by the customers of low-wage industries, which means the cost is broadly dispersed among all of us.
11.6.2006 3:19pm