A balanced view of ad hominem judgments

by Carl V Phillips

Tap tap tap. Is this thing on?

Welcome back to this blog. As many of you know, The Daily Vaper, where I published most of my good material for a year, has ceased publication (the articles, fortunately, are still archived at my author page at dailycaller.com, and they redirect from the original links if you have used those somewhere). I also recently did a “best of” Twitter thread highlighting some of what I wrote there (and here and elsewhere). There is something simultaneously atavistic and postmodern about watching (now nonexistent) the DV website slip slowly down the list of top guesses for where I might want to go when I open a new browser tab.

I am writing most of my subject-matter analysis under contract these days, with a bit of freelancing for commercial websites. Deep-think tangents will start to reappear here. Like this one. (I thought about doing it as a Twitter thread, but I realized that would never work.)

The purest form of ad hominem fallacy is to criticize an analysis based entirely on who it was that wrote or endorsed it. As in, “I read this paper, the methods and analysis were clearly presented, and the stated conclusions followed from the results, but I still don’t believe them because I don’t like the author or who he associates with.” This is, obviously, moronic. A minor variation — the most common form of “reasoning” used by tobacco controllers — is, “I did not even try read this paper [often meaning: it was is beyond my ability to understand], so I have no idea whether it was tight, but I am going to declare the results are wrong because I don’t like the author or who he associates with.” This is moronic for the same reason, and is also pretty pathetic to implicitly admit.

But these bits if idiocy do not mean that there is nothing to be learned from what might be called an ad hominem analysis. This requires far more effort, knowledge, and wisdom than most knee-jerk ad hommers are capable of, but its value should not be dismissed just because it partially resembles the knee-jerk crowd’s anti-scientific approach (such a dismissal, ironically, might be thought of as a second-order ad hominem attack).

Should you consider the known history of the author when assessing a paper? (Note: I am using “paper” as a shorthand for any published analysis where the reader can follow the reasoning; it could be a research paper, essay, book, position statement, or even a detailed Twitter thread. This contrasts with an unsupported free-standing assertion of a conclusion, which is necessarily judged entirely based on how much you trust the author.)

Yes, of course. This obviously does not mean you should let the author’s history override what you learn from actually reading the paper. But the methods and analysis are almost never fully presented in papers. Unless you are a huge expert on the subject matter, you may not recognize there is cherrypicking of inputs or references. Unless you are an expert on the methodology, you might not recognize tricks that were used in it, even if they are openly reported. Thus, you almost always have to decide how much you trust the author. Science (which I define very broadly) is all about trust, contrary to the simplistic lessons from grade school that it is all about skepticism. It is a rare paper that is such a complete presentation that you should be willing to think, “I don’t trust this author further than I can throw him, but the analysis is clearly correct,” (and a paper of that quality is almost certainly written by someone who is impeccably trustworthy).

On the subject of authors worthy of throwing, consider an extreme case: Stanton Glantz and his colleagues and minions at UCSF. (The groups at Bath and Karolinska are pretty similar, along with, of course, most of the anti-tobacco groups and government agencies. The UCSF group are the extreme case in this space, but are not outliars [sic].)  Basically everything they publish about tobacco products is a lie. That is not hyperbole. They use junk science methods, reported poorly, and draw conclusions that do not follow from the evidence in basically everything they do. You should never believe any conclusion from one of their papers. This is not because of their funding (usually, but not always a red herring — see below) or because they are they are “on the other team.” It is because there is overwhelming documented concrete evidence that most of what they write is lies.

You might choose to read one of their papers in detail to try to mine some genuine information, which often appears despite the overall dishonest narrative. You might want to read it just to know what they are on about now, in the same way (sensible) people read Trumps tweets. But you should never believe any conclusions, nor assume that unreported methods and opaque steps in the analysis were done correctly. You know this by virtue of the authorship alone. This is proper ad hominem analysis.

For authors who are known to often do junk work, but not always lie, a bit of deference should be offered, but not much. You might not want to assume the whole thing is junk. But when you read it and wonder if they might have skewed their analysis by doing X (and omit any mention of whether or not they did X), you should assume they did based on their history. It is important to keep in mind that X usually includes running their data through various models and reporting only the one that produced their preferred result, pretending that was the only result they got (I have written a lot about this elsewhere — example.)

It is a bit tricky to sort this out from knee-jerk ad homming, in the tobacco research space, because there is such a high correlation between “tobacco controller” and “most of what they write is lies”. It is useful to think of some other realm where you have strong political views but there are some with opposing views whose analyses you trust to be solid, though you still might read the details and find fault. (If you have no views fitting this description, such that there are some authors in the space who you usually disagree with but whose analyses you assume will be honest and reliable, consider that perhaps you are a knee-jerk ad hommer.) I wanted to provide an example of someone “on the other team” who you might disagree with but should generally trust, but I literally cannot think of anyone. You might have to carve out individual pieces that a few of us on “our side” write that express skepticism about some of the cheerleading and sloganeering on our side. Those are examples of someone you (presumably) trust writing things that you might not agree with, but you are inclined to believe they must have something valid to say.

The proper ad hominem analysis contrasts sharply with what tobacco controllers do. They do not identify any serious flaws in the corpus by a particular author (and in many cases could not even if they were not too lazy to try, because they do not exist), but merely dismiss his work because they do not like his views. I have watched with amusement as they attacked fatally flawed papers from “our side” — pieces that can easily be shown to fail on their merits — based only on ad hominem attacks on generally reputable authors.

Tobacco controllers (and many others) typically focus on funding in moronic ad hominem attacks. This is not surprising because actually addressing issues of whether the author is honest and does good science is beyond their ken; they understand about as much about honesty and good science as a cat. But the funding they talk about is usually, not always, a lousy basis for an ad hominem analysis.

First, the fact that someone funded a particular paper is completely uninteresting. That money was already paid or promised before the research was published, and so offered no further incentives. However, trying to please funders who you expect to renew ongoing “center” type operations, but who have not promised the money, or fishing for new funding can affect present conduct. I had a senior colleague once whose policy was to never take research funding from the same entity twice (a luxury that no longer exists, except for maybe Nobel Prize winners). This was the perfect proof against funding-based conflict of interest, even at the subconscious level. But it is a bit overkill. It is also another case where anyone who would do this is obviously so honest and scrupulous that he is last person who actually needs to do it.

This means that the usual “this paper was funded by X, and therefore…” always falls onto the moronic side of ad homs. An ad hominem analysis of funding needs to look at whether the prospect of future funding is being dangled in front of the researchers. That takes more analysis — only a tiny bit more, but even that is beyond the abilities of the usual ad hommers. Of course this only only the case when (a) the funder is the type who would pull funding if the researchers published legitimate work that produced conclusions the funder did not like and (b) the researcher venal enough (and/or vulnerable to peer-pressure) to let that override whatever integrity he might have. The latter is certainly the case for many tobacco control researchers. The former is the case for basically all tobacco control funders but — and this is important — not for industry funders. There are documented cases of tobacco controllers pulling someone’s funding for getting the “wrong” results, whereas no company would dare do that even if they were so inclined (which few are).

Notice this in particular this means that, in the tobacco research space, the people that are most likely to be affected by funding are employees of anti-tobacco operations: CDC, NIH, FDA, health departments, FCTC, anti-tobacco quangos, and Legacy/Truth and their ilk. Authors with that employment know that their future paychecks depend on staying on the good side of some seriously monomaniacal and unforgiving bosses. I am always floored (though never surprised) when one of them publishes a paper and declares “the authors have no conflicts of interest.” There is barely any greater conflict of interest.

Coming in second in the space are those receiving potentially ongoing grants from those organizations or junior researchers who hope to get such grants or staff positions. An obvious example of this is where someone has a big-money “center” grant (as with FDA CTP funding of shops at a dozen universities), making the careers of the lead investigator and many of the employees dependent on renewals. Junior researchers who are sucked into this space are told, in no uncertain terms, that toeing the party line is the only way they will get their turn to suckle at this teat. (Quite literally — I’ve watched it happen, with students bailing on working on THR with me to go work with third-rate hacks who intimidated them with threats (probably valid) about their career prospects.) There is good reason to believe that people in these positions will alter their “research” to please the funders.

Of course, not everyone is willing to sell their intellectual integrity. A lot of the correlation between “funder’s goals” and “researcher’s views” is caused by funders and perfectly honest researchers, who happen to already have similar views, seeking out one another. An ideal ad hominem analysis should thus look at evidence about just how willing to sell out the individual is. The clearest example in the tobacco space might be Jack Henningfield, who was a ferocious opponent of THR when he was being paid by Glaxo and then became a big fan of low-risk substitution (never admitting he had ever been otherwise) when he started being paid by Njoy. But this can be observed even among those who seem to not switch sides. Glantz et co., despite all their junk science, were never really part of the anti-THR cabal until FDA started doling out big money for anti-THR. Then they became all about anti-THR and the war on nicotine.

There is plenty more to say about all of this, but just planting this basic ideas about proper ad hominem analysis is a good start.

Advertisements

12 responses to “A balanced view of ad hominem judgments

  1. This is so egregious I’d like to be surprised that nobody in the press has noticed there’s quite a big juicy story here. https://grrattitude.org/2016/06/11/is-it-time-to-wake-up-the-press/

  2. Thanks, but most of what you wrote I had previously gathered between the lines in the movie “Thank You For Smoking”. In it’s day most people thought that it was about ruthless, evil, Big Tobacco, when in fact it was about money and how most people justify a cause that exploits their skill set in order to earn it. Hilarious if you can put aside how familiar & realistic the characters are.

  3. Glad you’re reviving this site!

  4. Vinny Gracchus

    Thank you for the excellent review of bias and corruption in tobacco control. This essay deserves wide coverage in the mainstream press.

    The problem is the press has either been captured by the corruption and/or is illiterate and innumerate and therefore promulgate the biased studies and their inaccurate, exaggerated or fraudulent data.

    An interesting study on the transmission of exaggerated and misleading causal assertions in health studies is recounted in Haber N, Smith ER, Moscoe E, Andrews K, Audy R, Bell W, et al. (2018) Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review. PLoS ONE 13(5): e0196346. https://doi.org/10.1371/journal.pone.0196346

    • Carl V Phillips

      Thanks.

      Yeah, that is a cute little study, though they kind of went a bit overboard on it (in terms of trying to make it sciencey, that is, not in the conclusions).

      The press is all about clickbait anymore. So they do not even try to get it right. Not that most of them are capable, but lack of trying makes it even harder.

  5. I tried to get the Media sub-committee of the Union of Concerned Scientists interested in this topic but never heard back from them.

  6. Good to see you back, Carl. I’m not groupie-ish enough to follow you around the internet, so I’ve just been checking back here once every week or two in the hopes of new content. And here it is!

    • Carl V Phillips

      Ok, so first I am disappointed in your non-groupie status, but I guess I will live with it.

      Second, since you are “here” and I understand fall into the category “read this blog, but don’t follow my Twitter” (that is about the extent of what a groupie could do), let me ask you: Is what I did here, linking to the index of my work from the last ~year while I neglected this blog good enough. Or would it be valuable to post more links and maybe reprises. (Thanks for any insight.)

      • Frankly, I would be in favor of either eventuality.

        I understand that everybody does Twitter, and that’s where a lot of things happen nowadays, but I just don’t do Twitter. Having said that, anything of yours that you make accessible here I would be delighted to read.

        • Carl V Phillips

          Ok, I will see what seems like worth summarizing and linking. Thanks for the feedback.

  7. Glad you’re back in long-form here Carl. I appreciated your work with DV, and brevity in your public discourse thanks to the discipline imposed by the editors. There is something, I hope, freeing about having this space to work in again. I enjoy both forms – calling this “Carl Unplugged”, and hope from here more publicly accessible writing can appear in commercial work.

    One of the key things, if I take your drift, is that simply dismissing a paper based ad hominem analysis as junk is only a small first step. It seems that what is needed is to hold a cleaner lens of science up and show not only the subterfuge and obfuscation being used as accepted methodology but what needs to be done to make the paper in question trustworthy.

    I see that not all social science publications are bad, but the relative quality does appear to center around the presence of a “team” and its proximity to regulators. In physical science teams do exist, but in a friendly and professional competition. The relationship between Feynman, Hawking, and Gel-Mann is a good example; as is the bet between Penrose and Hawking. But take a trip into Social Science land and such cooperative competition begins to become rare. It is most rarefied under the umbrella of Regulatory Science, the shelter TC stands beneath.

    This is where good ad hominem analysis seems most necessary. The track record of the research group matters, as does their funding source, but more so the science used. An understanding of where the near misses are (ok – “shot at the wall but hit the tree.. near” in the TC arena) allows replication with the identified flaws corrected, vis: Pankow’s formaldehyde study vs Farsalino’s replication. Developing good analysis can lead to even better design of experiment for replication.

    The problem of persistence still needs to be addressed. Noting the problem that flawed studies are given equal weight as good ones – and the preponderance of evidence (since the BS asymmetry principle applies) tends to favor the shoddy work – both in the public and to those that seek to regulate the public. It seems the message needing to be repeated isn’t an attack on the perpetrators themselves, but simple messaging about the what would be needed to make a junk study something meaningful. Yes, sometimes the flaws are so egregious they should be ridiculed (and Twitter feeds are full of such attempts, some actually good). Such messaging may help to foster a higher level of trust in the small body of good science, while it reduces trust in those products of less-than-accountable ‘scientists’ who habit the space.

  8. Glad that you have you back, Carl. I read your stuff on the vaping site when I happened upon it.
    It is the persecution which I abhor. Deliberately forcing up tobacco product prices to force poorer smokers to give up smoking is uncivilised to say the least. Smokers are modern day lepers. What was the latest abomination from New York? Smokers not to be allowed to walk along the street smoking? They must stand still? That is not far from ringing a bell and calling out, “Unclean”.
    Quite a few people in my local pub vape, and good for them. Their choice.I would buy one of those Juul contraptions just to try it out were it not for the fact that the heets are still subject to massive taxation. You would think that ‘Public Health England’ would lobby for tax-free heets if they were serious about THR.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s