Listener Feedback XX

Skeptoid dips into the feedback mailbag to respond to comments from listeners.

by Brian Dunning

Filed under Feedback & Questions

Skeptoid #306
April 17, 2012
Podcast transcript | Listen | Subscribe
 

Today we're going to open the mailbag and respond to some listener feedback. Usually the feedback springs out of the bag like a honey badger, hits me in the face and sprays blood on the wall like a slasher movie, but today I wanted to select some more rational comments and reply in a more rational way. These emails we're going to read today illustrate pretty common pushback that I get from people who are miffed by my takes, not on specific subjects so much, but on the scientific method in general.

I should be clear on one point: I usually only include an excerpt from these feedback emails. Most feedback raises a number of different issues, and for the sake of brevity and keeping on point, I generally include only the part that I'm responding to. What I don't do is take anything out of context or otherwise change the author's meaning.

Kent from Illinois sent in the following feedback to the episode about the Antikythera Mechanism, an exquisite archaeological find that greatly improved our knowledge of ancient Greek technology. Some say it had to be alien in origin or is otherwise unexplainable, but my analysis was unable to reach the same conclusion. Wrote Kent:

It's funny to see the similarities between the skeptics and the ancient-alieners. Both need an answer. One falls into the unchanging rational gestalt, the other hops on the popular bandwagon. You both MUST answer the question, and stop WONDERING. Some mysteries can not be answered because of limited information. Explain the Piri Reis map Mr. Dunning. To consider yourself a skeptic or a believer is to close your eyes.

It appears that Kent and I are defining skepticism differently. I think it's accurate to rephrase what he's saying as "You should neither always believe everything nor always reject everything", which is of course quite true. If so, he's defining skepticism as the rejection of everything, which is not at all the definition I'd use. The process of critical analysis separates good evidence from bad evidence and results in an informed provisional conclusion. If Kent has truly listened to any number of Skeptoid episodes and determined that I always reject everything without responsible critical analysis, then either I'm not doing my job very well or he hasn't listened very carefully.

Incidentally, the Piri Reis map that he mentions is a world map compiled in 1513 by Ottoman cartographer Piri Reis by piecing together fifteen other maps. Although popular sources frequently credit it with inexplicable accuracy, or a completeness impossible for its time, neither is true. It's so complete because it was sourced from so many different maps from different countries covering different continents, so its completeness is not unexpected; and its accuracy is no greater than that of those smaller maps. Some land masses are rotated or out of scale, because Reis didn't always have complete context. It is a valuable and excellent example of ancient cartography, but there's nothing unexplained or mysterious about it. We might look at it in deeper detail in a future episode.

Rory from White Bear Lake commented on my episode about ghost hunting tools of the trade, an evaluation of the validity of using simple electronic gadgets when trying to find ghosts. Ghosts have no known properties, so it's hardly logical to look for them using devices that sense very specific properties. Rory's focus is on EVPs, electronic voice phenomena, mysterious voices that appear on audio recordings even though researchers heard nothing at the time:

My group has done over 40 investigations. We have picked up some very clear EVPs including ones that have answered questions directly. My group has tried the cell phone experiment and our recorders didn't pick up our call. I am a musician and have trained ears. I would also know if we were picking up radio or TV signals. EMF meters are normally used to see if an area is worth staying at for further investigation. I don't how Brian would explain an EMF reading in the middle of an open field that is in the middle of nowhere and you are 99% sure there isn't any source of electricity near. We can't always explain some of the audio or visual items we find but that doesn't mean we didn't find anything of value.

I'd go even further, and say that it doesn't mean anything at all. Unexplained anomalies are just that; unexplained. That's not the same thing as valuable data. It's interesting, and it's useful as far as suggesting where to set up your microphone and hope to get something better, but by itself it's meaningless.

Rory mentions his experience as a musician with trained ears. Although I appreciate that, it's not a relevant skill set for what he's trying to do. Understanding of research methodology would be far more useful. Understanding of the ways human brains can fool themselves, and the fallibility of perception, would be great as well. My encouragement to Rory's group would be to leave the musicians at home and bring along experimental psychologists instead.

Rory didn't specify what he suspects the EVPs might be, but most EVP hunters usually have ghosts high on their list of suspects. How did they rule out Martians? Why aren't they looking equally hard for Russian psychics projecting mental images at them? Why not the souls of the surrounding trees? All of these possible culprits are as equally undefined as ghosts; yet the ghost hunters have dodged around this fundamental step and are trying to match their observations with their preferred explanation of ghosts. This isn't because they're not good enough musicians; it's because they're not good enough at defining research methodology.

Darren from England wrote in regarding my episode on wheatgrass juice, which was a major food fad about five years ago but has declined in popularity since then. Its supporters claimed all sorts of amazing medical benefits from drinking it, none of which were ever supported by reliable testing; and its detractors pointed out that it was merely an absurdly expensive fad and that, as grass, it contained virtually nothing of nutritional benefit to the human body. Nevertheless, Darren said:

There is a fair bit of science supporting some of the benefits of wheatgrass juice, but let us suppose for a moment there isn't.

What if there was a sceptic, one who was dismissive of the benefits of wheatgrass juice?
What if that sceptic were to carry out an experiment?
What if that experiment was to involve drinking wheatgrass daily for a period of time?
What if that sceptic were to drink 3 fl oz. of wheatgrass juice every day for a period of 3 months for example?
What if before carrying out the experiment the sceptic got a variety of health checks carried out, bloodwork etc?
What if the sceptic got the same health checks carried out after carrying out the experiment?
What if the sceptic made no other changes to his lifestyle during that period?

What if that sceptic was Brian Dunning?

Up for the challenge Brian?

I'm about to carry out the same experiment myself, having never tried wheatgrass juice,but unlike Brian I am willing to be proved wrong based on my own experience.

It probably won't surprise Darren to hear this, but he's right, I'm not willing to be proven wrong based on my own experience; and furthermore, I would also encourage Darren not to let his own experience change his mind either. The reason is that personal experiences are a terrible way to learn something. As human beings, we are all subject to preconceived notions, personal biases, and differing expectations; and of course any one person's personal sampling of something is, by definition, an uncontrolled, unblinded test subject to external influences and all manner of unknown variables. This is why we all know people who have reached opposite conclusions based on their experiences. They can't all be right, and that's proof enough that personal experience is an unreliable way to learn practically anything.

Tip Skeptoid $2/mo $5/mo $10/mo One time

Instead, we turn to well-designed, blinded trials that employ controls to eliminate bad data caused by all of these weaknesses. Running such a trial takes time and money. This has already been done with wheatgrass juice, and the results of such trials are always going to be more reliable than my own personal experience or Darren's. If I were to try wheatgrass juice, and I were to experience whatever health benefit Darren believes I would, I'm smart enough not to let my personal experience interfere with my professional assessment. This isn't always easy to do; but that's one nuisance of maintaining a truly open mind. You have to be willing to accept what we can prove even when it contradicts your personal experience.

Finally, Nathaniel from New York replied to the episode on Mao's "Barefoot Doctors" who practiced what came to be recognized in the West as traditional Chinese medicine; a recognition based at least in part on a popular abridgement of the Barefoot Doctor's Manual that omitted all the modern medical information, leaving only the last-ditch herbal equivalent. This resulted in a widespread belief in the West that traditional Chinese medicine excludes modern medicine. Nathaniel was unhappy with this analysis, and wrote:

I wonder if skepticism is curable by acupuncture. It is such a vicious disease; or rather, it is more like a poison- beneficial when used appropriately, yet hopelessly harmful when overdosed.
I only glanced at this material, but it was obvious that the author does not know enough about the subject. I therefore agree that it is best to read articles by experts. Expert skeptics seem to be mostly expert at skepticism, and willing to apply it at all cost. Who scientifically verifies this nonsense?

Skeptoid is not a peer-reviewed publication, rather it's a survey of existing previous research and, as closely as possible, represents the best information available on each subject. Of course mistakes always slip through the cracks, and these are corrected whenever they're found in periodic episodes of corrections. If you found an error or misleading omission in the Barefoot Doctors episode — as implied by your comment that I don't know enough about the subject — then by all means email me the correction.

I certainly agree that too much critical analysis of a given subject often reaches a point of diminishing returns, but I would not agree that its use is like a disease. On the contrary, I'd argue that it's more like a cure for incomplete or misleading thought processes, that all too many people lazily embrace. Simply accepting whatever you're told, whether that's to believe something or to reject it, is hardly a way to improve your knowledge and make the best life decisions.

Brian Dunning

© 2012 Skeptoid Media, Inc. Copyright information

References & Further Reading

Barušs, I. "Failure to Replicate Electronic Voice Phenomenon." Journal of Scientific Exploration. 1 Jul. 2001, Volume 15, Number 3: 355-367.

Editors. A Barefoot Doctor's Manual: A Concise Edition of the Classic Work of Eastern Herbal Medicine. Philadelphia: The Running Press, 2003.

Freeth, T. "Decoding an Ancient Computer." Scientific American. 1 Dec. 2009, Volume 301, Number 6: 70-83.

Juliano, D. "Ghost Hunting 101." Ghost Hunting 101. The Shadowlands, 1 Jan. 2009. Web. 2 Nov. 2009. <http://www.ghosthunting101.com/>

Lister, C. "Wheat Grass Nutritional Analyses." Crop & Food Research. The New Zealand Institute for Crop & Food Research Ltd, 12 Sep. 2002. Web. 9 Nov. 2006. <http://www.barleyleaf.co.nz/rightpages/WheatGrass.html>

Yerci, M. "The Accuracy of the First World Map Drawn by Piri Reis." Cartographic Journal. 1 Apr. 1989, Volume 26, Number 2: 154-155.

Reference this article:
Dunning, B. "Listener Feedback XX." Skeptoid Podcast. Skeptoid Media, Inc., 17 Apr 2012. Web. 27 Nov 2014. <http://skeptoid.com/episodes/4306>

Discuss!

10 most recent comments | Show all 18 comments

While I totally agree that science is the way to decide on the effectiveness of things such as wheatgrass, cleanses, etc, as far as medical science goes, there is the issue of when is a placebo effect bad? As long as one is willing to say "this makes me feel better" and is willing to continue with generally accepted medical checkups, etc, and the activity will not harm you, is it wrong to go ahead with the activity? In other words, If wheatgrass makes you feel better and does not harm you, why not drink it? Before you all go off the deep end here and tell me it absolutely matters because science is king and we need to be realists, I am NOT saying you should believe that wheatgrass makes everyone better if it works for you. As long as you understand there is no scientific reason for your feeling, but you still feel better anyway, I don't see a harm. You're not denying science--you're just doing something you feel good about. It's a fine line--but I don't see the placebo effect as always being bad. As long as you recognize the fact that it is a placebo.

Sheri, Wyoming
April 20, 2012 9:20am

Brian, I tend to be easily swayed by argument, and a persuasive speaker can usually hook me, especially if they are able to engage my emotions. Your articles which teach not only the scientific method, but also critical thinking and logical fallacies have been so helpful to me. Instead of being convinced by whoever spoke last, I'm starting to analyze the tricks being used to con me and I feel better prepared to use my own mind to find out what's really being said (or not said).

You've debunked a few things for me that I appreciate knowing the truth about, and you've given me tools to avoid being a patsy.

Thank you very much, and keep up the good work!

BTW, I'm a Christian, and I'm not at all offended by your remarks about God and religion. You're absolutely right -- God cannot be proven, or disproven, scientifically.

Cassie, Germany
April 21, 2012 1:42pm

@Sheri> I can't speak for Brian or anyone else's opinion on the subject, but I'll tell you my thoughts on it. I think the problem has several levels. First is that often people who engage in treatments that are unscientific (chiro, homeopathy, acupuncture, reflexology, etc.) many times do so to the exclusion of legitimate treatments and not in conjunction with them. People do things, feel better, and don't receive treatment that may be necessary. If everyone who held with unscientific treatments actually did receive treatments from actual doctors, well, it wouldn't be great, but at least potential harm would be minimized. However, we know this isn't the case. Next, when you validate pseudoscience in any fashion you open the floodgates. If one person is drinking wheat grass and receiving actual medical care in addition to it claims the juice helps them, you run the risk of having one of their family, friends, or gullible Internet acquaintances take it to heart sans the actual medical care. Additionally, while "there is one light of science, to brighten it anywhere is to brighten it everywhere," to dim it anywhere is to dim it everywhere. When you advocate a relatively harmless treatment like wheat grass, you tacitly allow more harmful pseudoscience into the arena. Chelation therapy for autism, or anti chemotherapy types who advocate the whole "alkaline body" thing, just to name a couple.

Matthew, Davenport, IA
April 22, 2012 6:03am

I just want to say, Brian, that you are incredibly patient and systematic in your responses. If it were me, I'm not sure I'd be able to resist embarrassing these critics with less professional discourse.

Tom, Rochester, NY
April 24, 2012 4:30pm

Sheri,
The "what can the harm be if it makes me feel good," and others like it (e.g., "It works for me", "As long as I'm not harming anyone...") are pretty common. And to the person who states that argument, it can be hard to refute. While the person may not be doing themselves any physical harm by drinking "Jesus Juice," there is real harm being done to society. For example, many insurance companies now pay for acupuncture, which of course raises the cost of healthcare for the rest of us. The question then becomes, are we responsible to society as a whole? Discuss.

Frank, Austin, TX (the enlightened City)
April 26, 2012 7:13pm

"As long as you understand there is no scientific reason for your feeling, but you still feel better anyway, I don't see a harm."

The harm is that this encourages magical thinking, which discourages scientific thought. While you may not be directly harming anyone, you're contributing to a culture which supports such concepts, which in turn leads to deaths.

In construction it's common to attempt to remove hazardous behaviors, whether they actually cause harm or not. This has had the effect of lowering the death toll of major construction projects. If you creat an environment that doesn't permit the conditions in which people get harmed, they tend to not get harmed. Similarly, if we want to fight insanity it's not enough to simply remove those things which kill people. We must accept rationality as a standard operating procedure, which includes not taking pointless and useless products.

You may not be directly harming anyone. But the company you're supporting does. You're helping that company stay in existence.

Gregory, California
May 3, 2012 11:34am

i was going to respond to the EVP thing, but Derek from NM did a pretty spot-on job. i'm also a musician, and attended 2 years of Audio Engineering school. while the musician aspect has absolutely zero relevance, i learned quite about recording equipment, in a professional setting. Derek is absolutely right: if a recording device isn't shielded properly and produces noise that it then records, it's flawed and wouldn't be used for a professional project. this day and age, even the most basic consumer recording devices are USUALLY sufficiently shielded, but certainly not always. those $15 digital recorders are a pretty good example of poor audio quality, but they're mainly meant for quick note-taking, NOT critical audio recording...and yet, these are often the exact same recorders used by so-called "ghost hunters". wifi, radio, microwave ovens, cellphones and a dozen other things i can think of offhand can potentially cause interference on them. everyone's heard that annoying cellphone interference through a nearby speaker, and those recorders can be affected the exact same way. there's a reason why professional field recorders can cost well over $1000: they're designed to give the cleanest, most accurate recording possible. the little digital dictophones, on the other hand, most certainly aren't.

Cat MacKinnon, Lakewood, CO
May 13, 2012 11:01pm

Nathaniel is right though "skepticism is curable by acupuncture" but they they use bigger needles and called it ice pick lobotomy

Anthony, sandusky
May 15, 2012 7:48am

WRT EVP

It amuses me that hiss is something of a nuisance when we try to listen to dedicated recordings, yet it is considered the perfect medium for hearing the dead or Klatu.

I mean, listen to an old 78 recording or an old - very old - black and white movie and tell me that the clicks, hisses and drop-outs don't alter the perception of the information that you receive?

If someone came up with a clear, noise-free recording of some long dead person I would be impressed - more-so if the dead folks were answering questions but no, we end up listening to hiss and have someone 'directing' us that it contains the words "I'm Cassie..." or something.

I have had exposure to a few 'paranormal investigation' groups over the years - indeed I was once almost a 'woo' - and, in my experience, without exception they are founded by folks who believe in spirits, ghouls and ghosts; which logically you would expect to be the case wouldn't you? I mean, for example, why would someone set up an investigation group to look for sasquatch if they didn't already believe it exists?

Paranormal groups invest a lot of time and money in their 'hobby' and it is natural for them to want some kind of end product.

What these 'investigators' don't seem to understand is that TRUE sceptics would love for there to be real, unequivocal evidence of something outside of our known scientific world.

Why are 'believers' so against real hard evidence? Is it because there isn't any?

Mr C, Portsmouth, England
July 22, 2012 7:25am

The sad thing is that psychic investigators never seem to find that lost will or hidden stash on nana's birthday cassette tape.

Mr C, Skeptics love anything that science digs up. Its all in the data and posit, review and publication. Not on the TV documentary.

Its that rush to publish that sort of kneecaps TV evangelism of cheap rot.

Has any TV psychic ever heard a cure for chemtrails yet? Possibly a blue print for a wunder waffen disguised as a packet of ersatz tobacco?

Happy birthday Grand ma... Happy birthday Nana...
"Klaus zu rauchen die plannen fur ze Volks skatenboarTT fur zwei!!!"
..appy birthday to you..

Would certainly kill ten birds with one stone.

Mud, back in Sanity, NSW
August 1, 2012 5:17am

Make a comment about this episode of Skeptoid (please try to keep it brief & to the point).

Post a reply

 

What's the most important thing about Skeptoid?

Support Skeptoid
 

Newest
Griffins
Skeptoid #442, Nov 25 2014
Read | Listen (10:34)
 
The Skookum Cast
Skeptoid #441, Nov 18 2014
Read | Listen (12:30)
 
That Elusive Fibromyalgia
Skeptoid #440, Nov 11 2014
Read | Listen (12:17)
 
A Skeptical Look at the News
Skeptoid #439, Nov 4 2014
Read | Listen (12:07)
 
The War of the Worlds Panic Broadcast
Skeptoid #438, Oct 28 2014
Read | Listen (11:56)
 
Newest
#1 -
Read | Listen
#2 -
Fukushima vs Chernobyl vs Three Mile Island
Read | Listen
#3 -
The Baldoon Mystery
Read | Listen
#4 -
Listeners Have Another Say
Read | Listen
#5 -
Tube Amplifiers
Read | Listen
#6 -
Hemp, Hearst, and Prohibition
Read | Listen
#7 -
Aromatherapy: Sniffing Essential Oils
Read | Listen
#8 -
Solving the Lead Masks of Vintem Hill
Read | Listen

Recent Comments...

[Valid RSS]

  Skeptoid PodcastSkeptoid on Facebook   Skeptoid on Twitter   Brian Dunning on Google+   Skeptoid on Stitcher   Skeptoid RSS

Members Portal

 
 


Follow @BrianDunning

Tweets about "skeptoid"

Support Skeptoid

Name/Nickname:  
City/Location:
Email: [Why do we need this?]To reduce spam, we email new faces a confirmation link you must click before your comment will appear.
Comment:
characters left. Abusive posts and spam will be deleted.