Recent Scientific Evidence News:

(1) The New York Times has a piece discussing the problems with adversarial expert testimony in the U.S., and promoting the Australian system of "hottubbing" as an alternative. I'm skeptical that this less adversarial approach will catch in the U.S.; despite it's long-term failure so far, I still think that finding a way to use nonadversarial experts (agreed to by the parties or if necessary appointed by the courts) is the way to go. Indeed, the Times doesn't mention it, but Australia (or maybe it's just some Australian jurisdictions) also is adopting a system requiring the parties in civil litigation to agree on a slate of experts.

(2) Balko and Koppl discuss sound ideas for reforming forensic science in Slate.

(3) ABC News has an extremely irresponsible report on families that fled Love Canal three decades ago. Apparently, and in contrast to previous studies, a new report forthcoming from the N.Y. Department of Health finds some elevated health risks among the evacuees and their children. But since the report hasn't been released, and the Department of Health declines comment, there is no way to evaluate it. Meanwhile, ABC repeats every unsubstantiated, and in some cases rebutted by earlier studies, claim about health problems among Love Canal evacuees.

(4) This isn't really news, but if the above topics interest you, you will undoubtedly want to download my recently published article in the Iowa Law Review, Expert Witnesses, Adversarial Bias, and the (Partial) Failure of the Daubert Revolution.

Sarcastro (www):
[Jeez, everyone seems to hate that Daubert! My evidence Prof. called it "Frye in drag." And don't get me started on my Wrongful Convictions class! Bullet lead analysis...

Yet it keeps on hanging on. I'll bet it outlasts Crawford.]
8.13.2008 6:32pm
SupremacyClaus (mail) (www):
Prof. Bernstein: As to adversarial experts, the situation is simpler than any lawyer realizes.

1) One of the experts is testifying in bad faith. That expert should pay all costs, and a mistrial is declared. Jail time for criminal contempt on the second false testimoney.

2) Both experts are testifying in good faith. A scientific controversy exists. The court has no competence to resolve such a controversy. One must go out and get more scientific data to resolve a scientific controversy. The case gets dismissed or gets limited to that within the knowledge of the jury.

Only a cases within the knowledge of the jury, or with only one side having an expert may proceed. In the face of opposing experts, the court lacks subject matter jurisdiction. The court is otherwise resolving a scientific controversy at the point of a gun. Such violent imposition of a false answer violates the procedural due process right of the defendant to a fair hearing.
8.13.2008 6:36pm
Vernunft (mail) (www):
Courts also resolve cases without having solved the philosophical problem of real causation, so perhaps they can manage.
8.13.2008 6:51pm
ejo:
what has happened with the silicosis radiology mills that was in the papers 1-1.5 years ago. if nothing has happened to the lawyers and quacks involved in that, the courts are useless.

the expert debate is no different from the debate re the Supreme Court controlling the conduct of war. you have judges with no knowledge or expertise making decisions on issues outside of their ken.
8.13.2008 6:52pm
Anderson (mail):
Good lord, Supremacy, have you thought that out?

How, exactly, do we prove that a given expert is testifying in bad faith?

With more expert testimony?

And the notion that two experts can't testify to opposite conclusions in good faith, without one's being wrong and another's being right, supposes a notion of "science" that peaked in the 18th century.

Personally, I would like to see the "hottubbing" approach in practice, but I doubt it's really going to affect the core issues, such as sexy-but-wrong expert vs. dull-but-right expert.
8.13.2008 7:11pm
Dave N (mail):
Anderson,

I agree with your analysis completely on this. I would love to see "hottubbing" tried here, but I doubt I ever will--it cuts too deeply against our adversarial system. I also like the idea of court-appointed experts who are truly neutral--but I am not holding my breath with respect to them, either.
8.13.2008 7:29pm
SupremacyClaus (mail) (www):
Anderson: The presumption is that both experts are testifying in good faith, and the case gets reduced to that within the knowledge of the jury. If people do not want to give up, here are some indicia of good faith testimony:

1) Experts should have used the same facts, and had an opportunity to enumerate them to each other, as in depositions.

2) The fees should be within a third of each other. If one fee is 50% higher or more, there is a temptation to please, by testifying in bad faith. The higher fee should be reduced by the judge, to insure absence of temptation.

3) The testimony work of the expert should be below a set fraction of total income. The expert may testify under oath, without providing tax documents. I am going to arbitrarily set the maximum at 10%. If I lose that fraction, I am starting to sweat about the bills. I am open to
argument about another fraction.

4) Prior inconsistent statements. In a similar case, with the same outcome, harm, and facts, the expert testified otherwise. OK. What explains the change? In the absence of new research data, or substantive personal experience, a prior inconsistent statement is a sign of bad faith.

4a) All the records of all the similar cases treated by the expert should be subpoenaed. If the expert failed to follow his own asserted standard of due care, a mistrial should be declared. The expert should be made to pay the expenses of both sides, and of the court, as a perjurer.

5) Repeated testimony for an attorney, or for only one side. If there is a lucrative and prolonged relationship with an attorney or one side, that is a sign, the expert does not want to end his meal ticket, and will shade his opinion to please his good customers.

As to hottubbing.

You are in the jury box. A bridge engineer conference debate breaks out, right there in the court, with the bridge engineers talking high fallutin' advanced bridge engineer controversy talk at each other. Now, they are breaking out the bridge engineering formulas on a blackboard, rapidly countering each other's calculations. Is that helpful to you as a member of the jury? Hottubing may take place during discovery. One expert may withdraw if presented with new facts and principles. If one expert withdraws in good faith, he should be commended and not sanctioned. That would leave only side with an expert, and preserves the fair hearing portion of due process, as well as the subject matter jurisdiction. Hottubing is OK, but in discovery, not in front of the jury.

As an attorney, I would like to get the bad news about my case from my expert during discovery and not during trial, as done in Australia. Do you agree that earlier expert conclusion helps the losing party?
8.13.2008 7:35pm
Anderson (mail):
Supremacy, I hope you're also proposing a separate court system to handle all that extra litigation.

But just about all the stuff you mention is already part of the process. Prior inconsistent statements? Impeach him with 'em. Etc.

Personally, I think that some (perhaps including DB) exaggerate the problems with experts.

The main problem is that expert testimony requires a LOT of work by counsel to make it presentable, understandable, and persuasive. The attorney really has to *become* the expert in his grasp of the material, and then orchestrate the testimony so that the attorney is in control 100%.

That is really hard to do. Particularly in cases with many experts.

But instead, you get experts who are pretty much dumped on the stand, eviscerated on cross, and then disbelieved by the jury. -- THEN the attorney blames the jury system.
8.13.2008 7:45pm
SupremacyClaus (mail) (www):
Anderson: The presumption is of good faith. Two experts show up. The case is dismissed as lacking subject matter jurisdiction in the face of a scientific controversy. If a subject remains that is within jury knowledge, it proceeds.

Examples in medmal include, giving a blood transfusion to the wrong name, and causing death in minutes. Wrong site surgery. Most of those will settle if the defendant has any decency.

This strict enforcement of subject matter jurisdiction would clear the court caseload. It would enhance the reputation of torts and of the court, by permitting mostly indisputable cases to proceed. It would establish the goals of torts for the first time.

Today, the current understanding is that torts are a form of land piracy undermining our economy, attacking productive entities for lawyer rent seeking, a kind of Mafia operation. The courts and torts deserve better than this reputation for pretextual mayhem.
8.13.2008 8:05pm
Modestme (mail):

Therefore, in the context of connoisseur testimony, courts should either replace adversarial experts with a panel of nonpartisan experts, or only allow an adversarial expert to testify if his conclusions are consistent with those of a nonpartisan advisory panel.


but why? This sounds like peer review. Peer review has slowed down real progress in the sciences and pretty much ended it in the soft sciences. Why import such a horrid device into the courts? And, seriously, there is no "nonpartisan" anyone in any field. Ever.
8.13.2008 9:34pm
DavidBernstein (mail):
I'm only looking for nonpartisan in the sense of "isn't tied to either side of the litigation," not someone who comes to court with no preconceived notions, which would be virtually impossible. As for your other question, I think you need to read that section of the paper. :)
8.13.2008 9:50pm
frankcross (mail):
There is no reason why a scientific controversy would mean that a case should be dismissed, for lack of jurisdiction or otherwise.

My instinct is to have both sides present experts if they wish and have a court-appointed expert. I suspect that generally the jury will defer to the neutral source, but the experts for the parties could serve as some check on the court-appointed expert, who will have his preexisting biases too.
8.13.2008 10:24pm
krs:
I wish they'd come up with a better name than "hottubbing."
8.13.2008 10:35pm
byomtov (mail):
Maybe the problem is not the use of experts but the use of a jury of laymen to decide technical questions.

Look at Anderson's comment:

The main problem is that expert testimony requires a LOT of work by counsel to make it presentable, understandable, and persuasive. The attorney really has to *become* the expert in his grasp of the material, and then orchestrate the testimony so that the attorney is in control 100%.

All true, no doubt, but it does raise the issue of why the credibility of expert testimony ought to depend on the quality of the presentation, rather than the quality of the expertise behind it.
8.13.2008 11:28pm
Katl L (mail):
"I still think that finding a way to use nonadversarial experts (agreed to by the parties or if necessary appointed by the courts) is the way to go"
In every civil law country is that way.
8.13.2008 11:52pm
jccamp (mail):
Given that in any set of alleged circumstances, it is not all that unusual that two experts will reach diametrically opposed conclusions based on the same observations, each conclusion remarkably similar to the respective theory of the case held by prosecution or defense. Is there any reason to think that replacing a partisan paycheck with one from the courts will change the spread of expert opinions? I suspect that defense now have more of a spectrum to choose from - not limited by the governmental labs' personnel - and generally tailor their requirements in terms of what expert they hire to those experts who will dispute the government's expert's findings. If the hiring is done by machinery within the court system itself, ostensibly with no dog in the fight, won't we still get wide variances of conclusions? Only, this way, we won't hear a second opinion. How is that going to help? In other words, will changing the employer of the experts have any effect of the quality/accuracy of the findings? I understand the theory, but what about all those whores with advanced degrees who will say whatever they're paid to say? Are they suddenly going to become both ethical and sufficiently versed to provide correct conclusions?

I suspect it will just make it more difficult to predict which whack-job theory they'll be pushing on any given day. At least now, we can easily see which team they belong to.
8.14.2008 12:10am
neurodoc:
In the face of opposing experts, the court lacks subject matter jurisdiction. The court is otherwise resolving a scientific controversy at the point of a gun. Such violent imposition of a false answer violates the procedural due process right of the defendant to a fair hearing.


SupremecyClause, what experience of expert testimony in tort cases informs your opinions? I ask because based on my experience of medical experts, and I dare say it that experience is considerable, I think what you propose makes little sense and has zero chance of adoption.
8.14.2008 12:25am
neurodoc:
This strict enforcement of subject matter jurisdiction would clear the court caseload. It would enhance the reputation of torts and of the court, by permitting mostly indisputable cases to proceed.
Yes, your novel approach to subject matter jurisdiction would do much to "clear the court caseload." And, best of all it would mean that courts wouldn't have to decide those pesky disputable cases that tie them up, leaving "mostly indisputable ones to proceed." (Proceed to what, a determination of damages, the other elements of a tort claim having been disposed of in the summary fashion you propose?)
8.14.2008 12:35am
ExpatAsia (mail):
I may be the only one on here that has superivised cases in Australia (Singapore, hk, China) and have several ongoing. As a US trained trial lawyer in Asia since 1995, I find it completely incoherent to have an adversarial system that incorporates the concept that expert evidence is some sort of positivist truth.

This is as true whether your expert is opining on hard science as applies to specific facts as an expert on choice of law issues, etc. I find the entire exercise entirely incoherent and the affidavits required in Australia complete nonsence.

The idea may play well in academia or to ideolouges that believe any litigation must be the result of bad faith by one party, (the same group that creates mandatory mediation, etc.) but in practice I find it absurd.

Have we forgotten the humility that is inherent in an adversarial system, that the truth is best sorted by opposing sides doing their level best to prove their side? With an independant judge and factfinder applying their experience and common sense to determine the outcome?

If you want a system that appeals to such non-adversarial process, come to Beijing, I'll show you one in all its glory.
8.14.2008 12:37am
Anderson (mail):
All true, no doubt, but it does raise the issue of why the credibility of expert testimony ought to depend on the quality of the presentation, rather than the quality of the expertise behind it.

That's true of *all* testimony. And don't kid yourself that judges aren't affected by presentation.

I get the dichotomy here -- substance vs. rhetoric -- but it's a straw man and always has been. There is no such thing in the real world as rhetoric-free persuasion. People who are frustrated by this should become math professors (and even then ...).
8.14.2008 12:23pm
Peter B. Nordberg (mail) (www):
Supremacy,

Does it sometimes happen that you start out knowing little or nothing about a subject, but then you listen to the views of knowledgeable people, with conflicting views, and ultimately find yourself able to frame an informed opinion?
8.14.2008 12:37pm
byomtov (mail):
That's true of *all* testimony. And don't kid yourself that judges aren't affected by presentation.

Again. True, but.

There is a big difference between evaluating testimony about subjects you have some grasp of and others where you know essentially nothing. In the former, presentation, while not unimportant, has less weight, maybe much less, than in the latter.

Also, I'm not advocating that we simply let judges decide these matters. I see no more reason for them to be able to understand the issues than juries. I think we need some sort of technical expertise brought into the process that is not drawing a paycheck, and maybe many future paychecks, from one side or the other.
8.14.2008 1:16pm
neurodoc:
Professor Bernstein, you mention "the conscious biases of hired guns, the unconscious biases of other paid experts." Some experts certainly deserve the pejorative label "hired gun," and I have had experience of a great many over the years. Do you have any useful indicia to distinguish "hired guns" from "other paid experts," though?

I know a couple of outstanding and unreproachable colleagues who are called upon frequently to testify as medical experts. They are paid very well for doing so, but "hired guns" would be a most unfair mischaracterization of them. On the other hand, I have encountered some medical experts who were not "frequent flyers," nor paid very remarkable sums, but who could fairly be called "hired guns," even "whores." (Is "whore" just a stronger pejorative than "hired gun"?)

Also, didn't you previously link to your full manuscript or another version of it? If you did, would you please point us to it again, so we can have more than just the abstract you linked to now.

And finally, can you or someone else explain this "hot tubbing" business in a bit more detail than Adam Liptak does. The opposing sides' experts sit down together and "dialogue" in front of a trier of fact, asking each other questions in an effort to show the weaknesses in the others facts and arguments?! Such a process is somehow less adversarial and does a better job of pointing to the right answer than simply having each side present their expert (direct) and the other side then have a go at them (cross)? Or have I fundamentally misunderstood how this legal "hot tubbing" thing is done?
8.14.2008 1:46pm
neurodoc:
Professor Bernstein, you mention "the conscious biases of hired guns, the unconscious biases of other paid experts." Some experts certainly deserve the pejorative label "hired gun," and I have had experience of a great many over the years. Do you have any useful indicia to distinguish "hired guns" from "other paid experts," though?

I know a couple of outstanding and unreproachable colleagues who are called upon frequently to testify as medical experts. They are paid very well for doing so, but "hired guns" would be a most unfair mischaracterization of them. On the other hand, I have encountered some medical experts who were not "frequent flyers," nor paid very remarkable sums, but who could fairly be called "hired guns," even "whores." (Is "whore" just a stronger pejorative than "hired gun"?)

Also, didn't you previously link to your full manuscript or another version of it? If you did, would you please point us to it again, so we can have more than just the abstract you linked to now.

And finally, can you or someone else explain this "hot tubbing" business in a bit more detail than Adam Liptak does. The opposing sides' experts sit down together and "dialogue" in front of a trier of fact, asking each other questions in an effort to show the weaknesses in the others facts and arguments?! Such a process is somehow less adversarial and does a better job of pointing to the right answer than simply having each side present their expert (direct) and the other side then have a go at them (cross)? Or have I fundamentally misunderstood how this legal "hot tubbing" thing is done?
8.14.2008 1:46pm
SupremacyClaus (mail) (www):
Peter: That's watching TV on a humanities subject. Still, I would not ever want to make life and death decisions, nor transfer $bils of assets after watching a think tank debate on C-SPAN, no matter how thorough and clear the review.

When it comes to airplane door design, or bridge engineering calculations, or radiation therapy dosing, I will never grasp those, short of full graduate training. Even then, I just will never get the math. No matter how long the training. I will always just have to trust the experts decision about a defect. When there are two opposing experts, I would reject deciding based on likability and slickness of presentation. I may flip a coin just to get home from jury duty.

Neurodoc may be a busy expert, thus is arguing in his own economic interest. It is not a matter of acceptance nor persuasion. It is a matter of obeying the rules of evidence and of civil procedure, and the Supreme Court decisions holding civil defendants have procedural due process rights.

I am not a lawyer, but have served as an expert. I experienced the adversarial process as a successful and unsuccessful litigant. It is unacceptable Medieval methodology. It is garbage, a Broadway production, a competition of fairy tales, even where I prevailed.
8.14.2008 2:57pm
DavidBernstein (mail):
Neuro, if you look, the abstract page I linked to says "download location." Choose a location, and you can download the paper.
8.14.2008 4:19pm
neurodoc:
SupremeClaus, I have never myself served as an expert, having declined all offers to do so. I had considerable experience, though, as a physician advising attorneys, and as a lawyer preparing and questioning experts, of many medical experts, including a few nurses. (A few "economist" types, too.) My experiences are, I think, not as potentially biasing as that of being either a successful or unsuccessful litigant myself in cases involving experts. And I consider myself much, much better informed than those who have little or no actual experience of experts in action, especially medical ones. (I'm with ExpatAsia on the value of actual experience and the adversarial versus non-adversarial approach.) Finally, and not meaning to be rude, and with apologies in advance for possibly coming across as such, but it wasn't necessary for you to say that you are not a lawyer. That is abundantly clear from your notions of "subject matter jurisdiction," clearing the decks for "mostly indisputable cases to proceed," empowering judges to whack the fees parties are paying their experts, etc. (Also, SupremacyClaus, defendants are already advantaged in a number of ways, most notably that it is defendants who have the burden of proof. It really wouldn't do to stack the deck in the ways you propose to give defendants still greater advantages over plaintiffs than they now have.)

Professor Bernstein, thanks for pointing out what I had overlooked, the link that was there. Anything to say about criteria for distinguishing "hired guns," with their conscious biases, from "other paid experts," with their unconscious ones. All paid experts are hired by someone, and potentially they can be effective "gunslingers" on either side. It is a common and erroneous belief (prejudice), especially among physicians who think meritorious malpractice claims are rare as hen's teeth though they cannot be unaware of negligent medical care, that all the "gunslinging," or "whoring" if you will, is on behalf of plaintiffs. Personally, I have seen it on behalf of plaintiffs and on behalf of defendants, and I find it equally offensive. (There was an article by Harvard authors within the past couple of years that purported to show that in obstetrical cases D experts had credentials superior to those of P experts, for whatever that says.)

Also, any more explanation of this "hot tubbing" approach? It sounds well-meaning, but not much more.
8.14.2008 6:52pm
DavidBernstein (mail):
If you read the article, you will see that I mention that one of the problems is that it's not easy in any individual trial to distinguish a "hired gun" from a sincere expert whose opinion happens to help a party's case, given that both get paid.
8.14.2008 8:30pm
Zoe E Brain (mail) (www):
I've acted as an expert witness in Australia. There is still, with the best will in the world, considerable pressure from the barrister paying the bills to get the expert to use language that supports his side's case. Keeping in mind one's only duty is to the court requires some willpower, as well as rigorous honesty. It's a bit like Bomb Disposal too, documenting every detail, omitting nothing.

If you do give in to the pressure, you won't be hired again, as you'd be likely to fold under cross-examination.

You can still be in error - that's another matter. But ideally, two experts hired by opposing sides will give the same evidence when it comes to facts, and will only differ when it comes to professional judgement.

A good expert can save money, leading clients to drop claims that aren't supported by the facts, and a good expert report delivered to the opposition can lead to a swift settlement when they realise they'll lose if it came to court.
8.14.2008 11:11pm
Richard Aubrey (mail):
As is obvious, IANAL, nor an scientist, nor an engineer.

However, it seems to me that by the time some aspect of the material world--either manufactured by or managed by humans--is in a position to damage a human being or property, the question is not one of science, but of engineering. Jurors are not presented with an explanation, or dueling explanations, of the law of gravity. They are presented with the fact that the scaffold in question was not designed to generally accepted specs. The question might be whether the specs are overbroad, do not take into account the new alloy, or something. But then somebody will look into the Handbook of Chemistry and Physics and find that even the new alloy wouldn't have held.

When things get more complicated than that, somebody's lying. As in the silicon breast implant question where we had parallell tracks. One medical study after another debunking the "crisis" and one trial after another awarding huge sums. The two were, by virtue of good (is that the word I want here?)lawyering, kept separate.
8.15.2008 11:13am
SupremacyClaus (mail) (www):
The subject matter jurisdiction is not discretionary. It stems from the Case and Controversy Clause. As the bankruptcy court cannot judge a divorce, so no court has the competence nor the authorization to judge a scientific controversy.
8.15.2008 1:38pm
neurodoc:
...no court has the competence nor the authorization to judge a scientific controversy.
We could debate what constitutes "a scientific controversy" when talking about legal causation, but why bother. No state or federal tribunal in the land has ever refused a case because it lacks subject matter jurisdiction on account of there being a "scientific controversy" somewhere in the picture. And wouldn't it be a bit lopsided if your approach was adopted and a defendant could create a "scientific controversy" simply by bringing forward an expert to contradict the plaintiff's expert, then call upon the court to dismiss the case for lack of jurisdiction?

Professor Bernstein, I will look to see what you say about criteria for the "hired gun" label. (I think I read your manuscript when you originally linked to it, but don't recall that issue, admittedly a relatively minor one.) I will be interested in whether the criteria would identify a well-respected medical school professor who testifies many times in the same sorts of cases for the same defense firm never saying anything he/she wouldn't say in a presentation before scientific peers as a "hired gun." And the same for those experts who regularly testify on behalf of plaintiffs. (Just to be clear, I freely acknowledge that there are many "hired guns" out there, even a good many "whores," and I know them when I see them.) But the opinions experts offer are far more telling than any criteria I can think of (e.g., balance of P vs D cases or all for one side?; volume of cases involved in; fees charged; etc.), and that "know them when we see them" makes "hired gun" versus "other paid expert" a largely subjective judgment.
8.15.2008 3:05pm
SupremacyClaus (mail) (www):
Neurodoc: Very good. You got it. The defendant expert must still testify in good faith. I have discussed indicia of good faith. Open to others. Only cases with one expert or within the knowledge of the jury may proceed without violating the Constitution. Prof. Bernstein has no ability to understand the self-evident reasoning, given his indoctrination. No lawyer in the US will ever understand that, after passing 1L. No one intelligent from 1250 AD could understand relativity theory, nor get persuaded of its validity after understanding it. The intellectual culture would be so alien to them. Even you have trouble.

The advantage for the court is that it starts to obey the Case and Controversy Clause. It stops appearing like a jackass to the public. It stops deterring entire industries, based on false allegations, doing permanent damage to the economy with obliviousness. It stops justifying intellectually and morally public self-help against the court itself, by reducing its incompetent tyranny at the point of a gun.
8.15.2008 5:25pm
neurodoc:
SupremacyClaus, your understanding of the Constitution is certainly a singular one.

You said you are not a lawyer. Would you mind saying what your educational and/or vocational background is, so we might have some idea about what informs your thinking? Also, would you mind telling us what you testified to as an expert, on whose behalf you appeared, and how the matter turned out?
8.15.2008 10:46pm
Soronel Haetir (mail):
I could see some benefit in the hottub concept in that one expert will have a better grasp of what questions to ask. I can easily see a repugnant expert getting the better of a charismatic expert if the repugnant expert's argument is valid.
8.16.2008 3:35am