• Starting today August 7th, 2024, in order to post in the Married Couples, Courting Couples, or Singles forums, you will not be allowed to post if you have your Marital status designated as private. Announcements will be made in the respective forums as well but please note that if yours is currently listed as Private, you will need to submit a ticket in the Support Area to have yours changed.

  • CF has always been a site that welcomes people from different backgrounds and beliefs to participate in discussion and even debate. That is the nature of its ministry. In view of recent events emotions are running very high. We need to remind people of some basic principles in debating on this site. We need to be civil when we express differences in opinion. No personal attacks. Avoid you, your statements. Don't characterize an entire political party with comparisons to Fascism or Communism or other extreme movements that committed atrocities. CF is not the place for broad brush or blanket statements about groups and political parties. Put the broad brushes and blankets away when you come to CF, better yet, put them in the incinerator. Debate had no place for them. We need to remember that people that commit acts of violence represent themselves or a small extreme faction.

Intercessory prayer study analysis

lucaspa said:
Are you getting the idea yet that the "Straight Dope" isn't? Or that he/she is a real dope? Misinformation is not limited to creationist websites.

And apparently Tessman and Williamson are not alone in their attempt to use ad hominems to distract from the issues. You say it is misinformation, but I've yet to see you do anything but deny that the staff of a double-blinded study need to be blinded. Why is that the case? Why is double-blinding useful?
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
nyj said:
I'm trying to figure out how this would skew the results. From my vantage point, I can't see how it would. Now, if she were telling the patients that someone really was praying for them, then I could see a problem. Unless of course you think that the intercessors could have given off "extra good vibes" knowing that their patients were doing better or worse than expected. Of course, if part of the point of prayer is to pray for something accurately, then the intercessors would need to know exactly what they were praying for, correct?

Byrd's Methods reads:

" Intercessors were given the patient's first name, diagnosis, general condition, and some pertinent updates in their condition. "

So we already know that they were kept up-to-date and needed to be in order to specifically pray for new complications.
 
Upvote 0
lucaspa said:
"Byrd's Table 3, which might best have been constructed by a panel of "blinded" doctors, was constructed by Byrd alone. But it was done in response to criticism of an earlier version of his manuscript, the writing of which had already required that the code be broken. Thus Byrd was no longer blinded when he determined the answer to the key question of which did better, the intercessory prayer group or the control group (Byrd, personal communication)."

This is what I have addressed THREE TIMES. Ifriit, if you don't start reading the answers FIRST, I'm going to get angry. :mad: The statistical re-analysis done by Cochrane's Review showed that Byrd did not influence the results at all. The results are "robust", which they would not be if Byrd had screwed up.

If it's making you mad, perhaps you shouldn't read it again. nyj requested a source, I provided it. The intent was not to represent the issue as unaddressed.

lucaspa said:
She kept the detailed records of which groups they were in, but not their clinical evaluations. Tessman has overstated Greene's role. I have seen where Byrd discussed Greene's role, and it did NOT include outcomes.

I'm sorry, but that interpretation of the quoted statement just seems silly. Detailed records of which groups they were in without clinical evaluation seems like it would be "prayed for" and "not prayed for." It doesn't seem worth mentioning, of course the coordinator would have to keep track of that.
 
Upvote 0

nyj

Goodbye, my puppy
Feb 5, 2002
20,976
1,304
USA
Visit site
✟54,248.00
Country
United States
Faith
Catholic
Marital Status
Private
lucaspa said:
Byrd's Methods reads:

" Intercessors were given the patient's first name, diagnosis, general condition, and some pertinent updates in their condition. "

So we already know that they were kept up-to-date and needed to be in order to specifically pray for new complications.

So obviously, if this was such a huge flaw in the experimental method (as the critics claim it was), the whole study would have been tossed into the trash during the peer review process. But it wasn't, so I can't see how this is a valid criticism. Or perhaps I'm placing too much faith in the peer-review process.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
ifriit said:
You say it is misinformation, but I've yet to see you do anything but deny that the staff of a double-blinded study need to be blinded. Why is that the case? Why is double-blinding useful?

You use double-blinding so that the person receiving the treatment and the person evaluating the results can't let their bias interfere.

That's the double part:

1. The person getting the treatment can't know if he is in the control or experimental group or may simply feel better because he feels he is "supposed" to feel better. Biofeedback or the placebo effect.

2. Where the evaluation is subjective -- such as how severe the cold is -- the evaluator doesn't know which group they are in so that the evaluator doesn't shade the evaluation.

Now, as both nyj and I have noted, SOMEONE in the staff of the double-blind study HAS to be unblinded so that the right people can get the right drug. In this case the drug was IP. So Greene had to know who was being prayed for to tell the intercessors.

However, she did NOT make ANY of the clinical decisions which went into the 26 categories. She didn't send them to the CCICU, or prescribe antibiotics, or diuretics or any of the other things. She wasn't evaluating the patients nor was she communicating with them. She was looking at the charts in order to get an update on what to tell the intercessors, but that had nothing to do with data gathering. The data was gathered by that point.

So, in terms of the two blinded groups, Greene was not part of either of them and could not influence either of them.

The only problem Tessman can have with Greene is what is implied he had with Byrd: IF Greene was taking down the complications and putting them into each group, then Tessman is saying that Greene was deliberately dishonest and failed to put complications for the prayer group and put false complications for the non-prayer group. That's that only way she could make an effect where there was none.

However, that assumes dishonesty in Greene and there is no warrant for that.
 
Upvote 0
lucaspa said:
I just addressed this. Tessman overstated Greene's role. Notice the use of ellipses ( ... ) in how Tessman quotes Byrd. You know right there that there is some out-of-context going on.

So show me how it's out of context; Tessman provided the source. I've been unable to find it online so far, however; the Journal of Christian Nursing's archives do not extend that far back.
 
Upvote 0
nyj said:
So obviously, if this was such a huge flaw in the experimental method (as the critics claim it was), the whole study would have been tossed into the trash during the peer review process. But it wasn't, so I can't see how this is a valid criticism. Or perhaps I'm placing too much faith in the peer-review process.

I do not believe it was specifically that they were being provided the information, but that it was collected personally by the coordinator who they state was supposed to be uninvolved by that point, and said details did not show up within the study.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
nyj said:
So obviously, if this was such a huge flaw in the experimental method (as the critics claim it was), the whole study would have been tossed into the trash during the peer review process. But it wasn't, so I can't see how this is a valid criticism. Or perhaps I'm placing too much faith in the peer-review process.

It's not valid. And you can bet that THIS study got the full treatment of peer-review. No one connected with it, editor and reviewers, wants to be associated with a flawed study HERE.

Tessman implies that Greene either
1. Was part of the clinical evaluation.
2. Entered the data wrong into the spreadsheet.

Greene didn't have an M.D. and was therefore never involved in clinical decisions and diagnoses, and these are the data.

So Tessman must mean that Greene had an opportunity to falsify the data and did so. That she entered fewer complications for the prayer group and more for the non-prayer group.

There is NO civil reason to do that, either.
 
Upvote 0

nyj

Goodbye, my puppy
Feb 5, 2002
20,976
1,304
USA
Visit site
✟54,248.00
Country
United States
Faith
Catholic
Marital Status
Private
ifriit said:
I do not believe it was specifically that they were being provided the information, but that it was collected personally by the coordinator who they state was supposed to be uninvolved by that point, and said details did not show up within the study.

However, since Greene was the only person who was unblinded in the study who could have access to the patient updates, it only makes sense that she would be the one who would handle that information. At any rate, I have this paper at home and I'll re-read it tonight (I discussed this issue a long, long time ago once)... right now I'm going off of memory, which may not be the best thing to be doing. :p
 
Upvote 0
lucaspa said:
She wasn't evaluating the patients nor was she communicating with them. She was looking at the charts in order to get an update on what to tell the intercessors, but that had nothing to do with data gathering. The data was gathered by that point.

Hm, agreed, I can't see where Byrd really states otherwise.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
ifriit said:
I do not believe it was specifically that they were being provided the information, but that it was collected personally by the coordinator who they state was supposed to be uninvolved by that point, and said details did not show up within the study.

The details were in the study. It's quite obvious from the Methods that someone is telling the intercessors the progress of their patients. That means the coordinator

Again, the data is NOT "collected" by the coordinator. Rather, the data is collected by the clinicians making the decisions, and these were blinded:

"The patients, the staff and doctors in the unit, and I remained "blinded',' throughout the study. As a precaution against biasing the study, the patients were not contacted again."

"After randomization, each patient was assigned to three to seven intercessors. The patients' first name, diagnosis, and general condition, along with pertinent updates in their condition, were given to the intercessors. The intercessory prayer was done outside of the hospital daily until the patient was discharged from the hospital. Under the direction of a coordinator, each intercessor was asked to pray daily for a rapid recovery and for prevention of complications and death, in addition to other areas of prayer they believed to be beneficial to the patient."

So we know the coordinator for the intercessor is not blinded, but like the pharmacist, the coordinator must be unblinded.

"I collected the information on each patient in a blinded manner, without knowledge of the spiritual status, condition, or ideas of the entrants during the study."

Do you see that? BYRD collected the data in a blinded manner. Not Greene.

Tessman is making it up and hoping you won't read the paper.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
ifriit said:
So show me how it's out of context; Tessman provided the source. I've been unable to find it online so far, however; the Journal of Christian Nursing's archives do not extend that far back.

I did. The ellipses say that Tessman left things out. By definition, that's out of context. It also directly contradicts what Byrd wrote in the Methods section, so doesn't that say Tessman tinkered with the letter?
 
Upvote 0
nyj said:
However, since Greene was the only person who was unblinded in the study who could have access to the patient updates, it only makes sense that she would be the one who would handle that information. At any rate, I have this paper at home and I'll re-read it tonight (I discussed this issue a long, long time ago once)... right now I'm going off of memory, which may not be the best thing to be doing. :p

I can't honestly claim to have any better basis; most of what I've found on this issue are from admittedly biased sources.
 
Upvote 0
lucaspa said:
I did. The ellipses say that Tessman left things out. By definition, that's out of context.

Wait, what? Ellipses are intended to remove information that is not in context, though they are frequently abused. Their use does not mean they have been so misapplied.

lucaspa said:
It also directly contradicts what Byrd wrote in the Methods section, so doesn't that say Tessman tinkered with the letter?

Not directly. I'd like to see what the original (JCN quote) said.
 
Upvote 0
lucaspa said:
The details were in the study. It's quite obvious from the Methods that someone is telling the intercessors the progress of their patients. That means the coordinator

Again, the data is NOT "collected" by the coordinator. Rather, the data is collected by the clinicians making the decisions, and these were blinded:

"The patients, the staff and doctors in the unit, and I remained "blinded',' throughout the study. As a precaution against biasing the study, the patients were not contacted again."

"After randomization, each patient was assigned to three to seven intercessors. The patients' first name, diagnosis, and general condition, along with pertinent updates in their condition, were given to the intercessors. The intercessory prayer was done outside of the hospital daily until the patient was discharged from the hospital. Under the direction of a coordinator, each intercessor was asked to pray daily for a rapid recovery and for prevention of complications and death, in addition to other areas of prayer they believed to be beneficial to the patient."

So we know the coordinator for the intercessor is not blinded, but like the pharmacist, the coordinator must be unblinded.

"I collected the information on each patient in a blinded manner, without knowledge of the spiritual status, condition, or ideas of the entrants during the study."

Do you see that? BYRD collected the data in a blinded manner. Not Greene.

Tessman is making it up and hoping you won't read the paper.

Hm. I think you are correct in this, though I'm more inclined to attribute it to incompetence than malice.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
ifriit said:
Hm. I think you are correct in this, though I'm more inclined to attribute it to incompetence than malice.

Please go back and look at Tessman. Now, from the Methods quotes above and the Acknowledgement of Greene, it is pretty clear exactly what role Greene was playing. Since Byrd can't be the coordinator, Greene had to have been. It's a no-brainer. Anybody familiar with scientific papers (as Tessman is supposed to be) knows exactly what is going on. DUH!

Now, Tessman portrays this as some type of conspiracy to withold information. Look how sinister he portrays the ambiguity of Greene's role in the project. How he only got that information years later from personal correspondence with Byrd. How Greene had access to patient information.

When you have incompetence of this magnitude, it's moot whether it is intentional malice or not; it's still malice. Of course, I don't think it is incompetence. Tessman has several articles of his own on PubMed.
 
Upvote 0

lucaspa

Legend
Oct 22, 2002
14,569
416
New York
✟47,309.00
Gender
Male
Faith
Methodist
Marital Status
Private
ifriit said:
Posner, Gary P., God in the CCU?, Free Inquiry, Spring 1999. <http://www.infidels.org/library/modern/gary_posner/godccu.html>

Ok, let's look at Posner's critique.

"Each patient's hospital course was given a severity score of "good," "intermediate," or "bad," based upon the degree of morbidity experienced by the patient. In addition, twenty-six categories of "New Problems, Diagnoses, and Therapeutic Events After Entry" were measured, and tested for statistical significance between the groups. These included such things as congestive heart failure, diuretics, hypotension, intubation/ventilation, pneumonia, and so on."

Posner has this backwards. FIRST the complications were looked at and the hospital course was "in addition". IOW, the general course was only done later at the insistence of the reviewers (Tessman and his discussion of Table 3, which is the general course). So, initially Byrd concentrated on objective measurements.

"Byrd says, "Based on these data there seemed to be an effect [from IP], and that effect was presumed to be beneficial" (emphasis added)."

Posner added emphases to try to water-down the data and make it look like the results are not as conclusive as they are. ALL studies use this tentative language. If we are to downgrade to dismissal studies who use this language, then nearly every primary article in the literature has to go, not to mention Darwin, who always used the most self-deprecating of langugae. All of science disappears.

"But what are those of lesser faith -- or of other faiths -- to make of this miraculous claim for the efficacy of prayer? Has the Judeo-Christian God been shown to exist, and to intervene in the hospital course of patients?"

Posner missed the point. God wasn't being tested. IP was.

"The most striking flaw in this study's methodology is one forthrightly acknowledged by Byrd. "It was assumed that some of the patients in both groups would be prayed for by people not associated with the study; this was not controlled for. . . . Therefore, 'pure' groups were not attained in this study." In other words, the focus of the study - prayer - was "not controlled for," except that three to seven intercessors were assigned to pray daily for each patient in the IP group, and none was assigned to the controls. Thus, although unlikely, it is nevertheless theoretically possible that the control group received as many prayers as did the IP group, if not more.

If "intercessory prayer" was not controlled, except that each IP patient was assumed to have received somewhere between X+3 and X+7 prayers daily, as opposed to X+0 for the control patients, what are we to conclude? That God is conditioned in a Pavlovian manner to automatically respond to the side with the greater number of troops, even though the assigned intercessors had no emotional ties to their patients, and even though the IP patients were otherwise no more worthy of healing as a group than were the controls? Does God not know that the side with fewer troops is in just as much need of assistance? Where is the evidence of his omnicience and compassion?"

Posner starts out with a supposed "flaw" in the methods and ends up discussing God and not the data from the methods.

What everyone wants, Ifriit, is something that will make an effect where there really isn't any. Will this do it?

You have an unknown number x praying for each patient. So, will that make a result of IP when there isn't any? NO!! What is more likely is that having x + 3 or x + 7 will NOT make a difference because x is already so large that adding a few more won't be noticed.

So, instead of saying the study is flawed, Posner has invalidly shifted the debate and tried to show GOD is flawed.

Posner is not discussing the study of IP, but the underlying hypothesis that it is God answering prayers and trying to show that this is not the case.

What is amazing is that, with only 3 to 7 additional intercessors, an effect could be seen at all!

Before I forget, what Posner and everyone else forgets is that Byrd used a TWO-TAILED test. That is, it looked at whether prayer made things better or WORSE. As Byrd wrote later, he really had no idea whether prayer really was beneficial because all the data was anecdotal and biased. Prayer COULD equally well have made things worse.

Now, meeting statistical significance on a two-tailed test is twice as hard as meeting it for a one-tailed test where you know the direction of the effect (if it is there). But Byrd erred on the conservative side. IF Byrd had used a one-tailed test (which Posner should agree to since he also thinks prayer should be beneficial), then instead of 6 categories being signficant, you now have 20 out of the 26 that are significant.

"But was this lack of significance truly "overcome"? One must note the interrelationships among these six categories: for instance, the development of congestive heart failure automatically leads to the need for diuretics; the development of pneumonia automatically requires the use of antibiotics; and the development of either would likely increase the risk of developing the other, of requiring intubation or ventilation, and of suffering cardiopulmonary arrest. "

None of these are true. Most pneumonias are VIRAL, not bacterial, and therefore don't get antibiotics. Congestive heart failure is not due to too much fluid and giving diuretics makes it worse because it makes the blood thicker and harder to pump. So Posner has misstated the medicine.

"In addition to the twenty-six categories previously described, three further variables were tracked during the study and tested for significance: "Days in CCU after entry," "Days in hospital after entry," and "Number of discharge medications." No significant differences between the prayer and control groups were found, despite explicit prayers for "a rapid recovery." Are we thus to conclude from all of the data derived in this study that although God may reflexively respond to the will of the majority, his manifestations are so marginal as to approach insignificance?"

First Posner doesn't like categories because they are interdependent but he wants these categories which are completely dependent on multiple variables. Can't have it both ways.

People only spent 2-3 days in the CCU and only 7 days in the hospital. Does Posner really think that these numbers -- gotten with material medicine -- can really be improved upon that much?

"The religious nature of Byrd's hypothesis may have been the attraction for the Southern Medical Journal, which is published in Birmingham, Alabama, in the heart of the Bible Belt. I assumed that the five-year gap between his study's conclusion (1983), and its publication indicates that a number of other journals had been approached prior to SMJ, but had failed to appreciate the historic nature of Byrd's alleged findings."

Notice that Posner now shifts from science to ad hominem. He has no evidence, but is assuming and damning based on that assumption.

"Byrd graciously responded to my inquiry on this point, informing me that he had received two prior rejections, which he called "the academic average. Perhaps the other two journals subscribe to the generally accepted axiom of science that extraordinary claims (particularly miraculous ones) require proportionately extraordinary proof."

Now we are back to that extraordinary claims thing again. Changing science. Once again, this is nothing but a rhetorical stick used to beat an idea that you don't personally like. I've seen it used THREE times in scientific journals, and all used the same way. The paper on evidence of life in the Martian meteorite was bashed because it was and "extraordinary claim".

I'm not sure what the average is. Most of mine have been accepted in the first journal submitted to, but maybe I haven't aimed high enough in prestigious journals. Lately I've been having 1 rejection per publication.

"This is not to say that studies purporting to demonstrate evidence of supernatural events ought not be published, as long as a journal's minimum standards of acceptability are met. Nature has published several such studies, but has historically accompanied them with statements expressing editorial reservations. (2) In contrast, Byrd's SMJ article was accompanied by a "Commentary" entitled "Religion in Healing," whose author says, "The paper by Dr. Byrd answers a question that has long been asked: Does prayer make a difference? His data say that it does." (3)"

Again, Posner is commenting on the hypothesis BEHIND the study. The Commentary is right on. Prayer makes a difference. Is that because God is answering prayers?? WE DON'T KNOW. Both extreme theists and extreme atheists ASSUME so. But Posner can't distinguish his assumptions from fact. If Posner assumes it, then it is fact.
 
Upvote 0

MartinM

GondolierAce
Feb 9, 2003
4,215
258
44
Visit site
✟5,655.00
Faith
Atheist
Marital Status
Engaged
lucaspa said:
Thus there is a trend. Where the prayer group is better, in 14 categories it is a lot better by 30-50% fewer patients. In the 5 categories where prayer is "worse" it is only by 1 or 2 patients. Example, 2 patients in the prayer group needed a permanent pacemaker compared to 1 in the control

Like some smart fellow said earlier, 'that's why you have statistical analysis' ;)

It's not valid to simply look at the differences and try to eyeball a pattern. Remember, the meaning of statistical insignificance is that we can't, to any reasonable degree of certainty, assert that the sample difference represents a true population difference. From the point of view of the population, those numbers may as well be identical. So trying to eyeball a pattern in the sample data and extrapolate to the population won't work. If there is a real pattern in there, we need a rigourous analysis to get at it.

I've heard this argument, but in looking at the parameters most are actually independent. For instance, many people think that pneumonia and antibiotic use are linked. But they aren't. Most pneumonias are viral and don't receive antibiotics

I'm not entirely sure from your comments, but you seem to be looking at correlations between the significant results only. Since the logistic regression used all 29 parameters from table 2, we need to look at dependence between any and all of them. Remember, multiple regression works by varying one predictor while holding all the others constant. Correlations upset that process. The bottom line: unless the variables can formally be shown to be independent, or the statistical dependence can be quantified, the analysis is meaningless. And even if such could be shown, the small sample size is still an issue.

Another, more fundamental, problem occurred to me last night. While Byrd ensured that the groups were well-matched in terms of age, length of stay and various pre-existing medical conditions, he didn't appear to check other confounding factors such as diet, body weight, excercise regime, smoking and drinking habits, etc. etc. Without some control over these factors, the results are weak, to say the least.
 
Upvote 0

MartinM

GondolierAce
Feb 9, 2003
4,215
258
44
Visit site
✟5,655.00
Faith
Atheist
Marital Status
Engaged
lucaspa said:
And, since he is looking for complications, he may not even have taken down that they occurred in the same patient. Just went thru and checked which of the 26 categories were "yes" and which "no"

Yes, that's a distinct possibility.

You can't "re-randomize" the data. The code is broken and you know which patients were in which group. It doesn't test the methodology at all. You get the same result Byrd did!

What I mean is that we could randomly separate the patients into two groups, check using Byrd's methods that the groups are as well or better matched than his and, if they are, repeat his analysis. If that gives the same result Byrd got, I guarantee there's a methodological flaw...
 
Upvote 0