Evidenced Based Medicine. The Mythical Holy Grail
“Absence of evidence is not evidence of absence.” – Carl Sagan
Complementary medicine seems to some, like a dirty word. Fuelled by some idea that all Complementary and Alternative (CAM) therapists are shamans and quacks, frothed and indignant bloggers flood cyberspace in the name of science to scoff and sneer at anything which might not be found in the annals of the BMJ, not that they have ever read it. This is the pseudo-scientist, who happily lumps his conveniently dim witted and proudly ‘sceptical’ views into two categories: those things that have been proven according to science and everything else which is junk, bogus and a scam, peddled by charlatans.
Generally speaking, these people represent the type of reasonably intelligent but naive buffoon, who whilst holding forth on science, perhaps even reading the summary of a paper or two, has never actually considered how you go about proving, or for that matter disproving anything scientifically.
The mistake they make is demanding that all CAM based therapies should be ‘evidenced based’ with most of them having not the slightest clue what this means, or what the comparison is. It is a commonly accepted principle amongst most medical practitioners, nurses, surgeons and clinicians, that a big chunk of daily medical practice often has little in the way of evidence to back it up and as much as 50% of general practice work is not evidenced based.
Most of it is based on what has been always done, hunches, ‘best practice’ and so forth. Pharmaceutical intervention fairs even less favourably and the US hosts thousands of deaths per year from drug overdoses and medical negligence. A lot of pharmaceutical testing has hidden outcomes and there are lots involving combinations of older drugs, that just don’t get tested at all. ‘Proof’ is not all it’s cracked up to be.
Now comes a study in the current issue of the Journal of Patient Safety that says between 210,000 and 440,000 patients each year who go to the hospital in the USA for care, suffer some type of preventable harm that contributes to their death.
The starting point for CAM therapies is to understand that however useless the sceptics might claim them to be, they tend to be generally harmless, as long as they do not attempt to convert the recipient away from their conventional treatment. Jumping through the hoops to demonstrate efficacy is no easy matter however. I am not for a minute supporting those who make wild claims to cure cancer with crystals, or generally talk unscientific bollocks to big up their own nonsense. What I am saying is that there is other stuff out there that we don’t understand and that it is foolhardy and arrogant to assume that we know it all. ‘Science’ should help more to develop ways of helping CAM to demonstrate efficacy instead of snidely sniping from comment pages in the Guardian.
To validate a physical therapy approach for instance, requires a treatment protocol to be written which sets a standardised approach and has everyone treated the same way. For most, this flies in the face of what CAM is all about, which is to treat the person presenting with the disease or problem, rather than treating the disease itself.
This presents a problem in itself, but this is only the start. The research paper might have to be submitted to an ethics committee (check here), to decide that the protocol being used is appropriate and does not adversely affect any control group. Then the study itself needs to be undertaken and funded, followed by this paper being written up, with statistics, a literature review and couched in a language which is generally not very accessible. There is a big disconnect between the academic designing a study and a therapist who, whilst having a good practical knowledge of their technique is not trained or equipped to undertake a serious piece of research.
But then surely once I’ve proved my theory/practice/lotion works everyone will accept it? Not a bit of it. Why the hell not?
“Ahh you see, you’re biased.”
“What do you mean I’m biased?”
“Well you had a vested interest in proving the outcome.”
“Of course I bloody well did, who else is going to do it?”
“No-one, but that’s not the point. It’s still first hand research and doesn’t really count.”
“What does then?”
“Well someone else has to do it again.”
“So I ask someone to do it again?”
“Oh no you can’t do that. You’d be influencing them.”
“What so I just have to wait around until someone decides to test out whether what I found out was true?”
“Precisely.”
“So until then can’t say it was?”
“Oh you can say it was, it’s just that no-one will take you seriously. Because you introduced a bias.”
“I give up.”
“Yes well that’s to be expected.”
The paper then has to find a publisher which will peer review it. Invariably the publication itself will be subject to derision or criticism, simply because it is publishing research papers which address CAM outcomes, irrespective of the quality of the research or the writing. The goal posts are hardly equal. The baseline is this: all CAM is effectively shit and if you go out and try and prove its not, then you are biased and your research isn’t valid. Tim Minchin, a funny and famous sceptic echoes the naive view of the majority of those of his religious persuasion, when he says “There is a name for alternative medicine that works. It’s called medicine.” It’s a sweet idea, but bears no resemblance to the complex and difficult arena which is called proof and is a bit like saying “If everyone laid down their weapons there would be no more war.” It’s true, but a bit more complex than that.
With hundreds of thousands of treatments being conducted every year and millions of pounds being spent, it seems backward to sit on the sidelines and scoff, even suggest that it’s rubbish, when a pro-active investigation could perhaps shed some light and help the so called victims of CAM.
It behoves us to understand that the things that define us as humans: love, sexual attraction, love of spinach, loneliness, fear, sexual orientation, even pain, have no consensus when it comes to defining them scientifically. Lack of evidence is not the same as evidence of lack.