Cochrane ReviewCochrane Reviews are systematic reviews. In systematic reviews we search for and summarize studies that answer a specific research question (e.g. is paracetamol effective and safe for treating back pain?). The studies are identified, assessed, and summarized by using a systematic and predefined approach. They inform recommendations for healthcare and research. authors Jolijn Verkuijlen and Jack Wilkinson explain what evidence is available to tell us whether psychological therapies, or educational interventions, can help couples coping with subfertility, whether or not they are having other fertility treatments.
Page last checked 3 April 2023
Many people struggle to have a child. If a couple does not manage to get pregnant after a year of having regular unprotected sex, we say that the couple is subfertile. Subfertility may be a source of great anxiety, distress and depression to those who experience it. When faced with difficulties conceiving, some people choose to undergo treatmentSomething done with the aim of improving health or relieving suffering. For example, medicines, surgery, psychological and physical therapies, diet and exercise changes..
One example of treatment for subfertility is in vitro fertilisation (IVF), where embryos are created in a lab using eggs and sperm. The best embryo or embryos are selected and are put into the woman’s womb, where it is hoped a baby will develop. Another example is intrauterine insemination (IUI), where fast moving sperm are separated from the rest and are placed in the uterus to increase the chance of fertilization. However just as the condition itself may have a negative impact on mental health, the process of undergoing treatment, often with limited chances of success, may be an additional source of distress. Approximately one fifth of all subfertile couples experience these feelings while undergoing fertility treatment.
As a result, subfertile men and women may be offered additional treatments intended to alleviate the burden. This could take the form of psychological treatments such as cognitive behavioural therapy, or simply the provision of information about subfertility and any corresponding treatment options. In our Cochrane Review Psychological and educational interventions for subfertile men and women (March 2016) we reviewed the evidence to find out whether or not these psychological and educational interventions are effective. Our first question was whether or not this sort of treatment actually improved the chances of having a baby. Our second was whether or not these interventions improved mental health. We were interested in interventions aimed at either men or women (or both), regardless of whether or not they were undergoing additional fertility treatment.
What were the studies testing?
We included 39 studies in our Cochrane review, and one of our first observations was how varied they were. Many different strategies had been investigated. The psychological interventions included encouraging patients to write about their feelings in a diary, cognitive behavioural therapy, and playing some calming harp music while women were having embryos transferred to their womb. Educational interventions included an interactive online guide, a sex information booklet and a face to face interview. The studies were also a mixed bag in terms of their participants and the control groups they compared the interventions to.
Before we started the review, we had intended to mathematically combine the results of the individual studies using a statistical technique called meta-analysisThe use of statistical techniques in a systematic review to combine the results of included studies. Sometimes misused as a synonym for systematic reviews, where the review includes a meta-analysis. , which gives an overall summary of how effective the treatment is. However, because we ended up with such a motley collection of studies, we decided that it wouldn’t make sense to combine them in this way. It would have been like comparing apples to oranges (and to pears and pineapples).
How good were the studies?
While the variation amongst the studies prevented us from combining their results, we also had some concerns about whether or not the individual results were likely to have been accurate. We evaluated the quality of the studies, and considered all of them to have at least one potentially serious problem in their design or execution. Consequently, one point became clear; performing clinical trialsClinical trials are research studies involving people who use healthcare services. They often compare a new or different treatment with the best treatment currently available. This is to test whether the new or different treatment is safe, effective and any better than what is currently used. No matter how promising a new treatment may appear during tests in a laboratory, it must go through clinical trials before its benefits and risks can really be known. of psychological and educational interventions is really hard.
In summary then, there were two issues that prevented us from answering our questions about the effectivenessThe ability of an intervention (for example a drug, surgery, or exercise) to produce a desired effect, such as reduce symptoms. of these kinds of treatments for patients with subfertility. Firstly, the studies were all really different; we would say there was huge clinical heterogeneity. Secondly, we weren’t confident that the results of the individual studies would be correct; we would say that all of the studies had high riskA way of expressing the chance of an event taking place, expressed as the number of events divided by the total number of observations or people. It can be stated as ‘the chance of falling were one in four’ (1/4 = 25%). This measure is good no matter the incidence of events i.e. common or infrequent. of biasAny factor, recognised or not, that distorts the findings of a study. For example, reporting bias is a type of bias that occurs when researchers, or others (e.g. drug companies) choose not report or publish the results of a study, or do not provide full information about a study..
While our review was unable to answer the question, we hope that it may still prove useful to researchers in this field. In particular, we: identified the specific features of the studies that gave us cause for concern; explained why they gave us cause for concern; and made suggestions as to how these problems could be avoided. Hopefully this will help researchers in interpreting the findings of published studies and will guide the design of future clinical trials in this area. Here, we discuss some of the recurring issues we noted during the review.
The problem of drop out
One form of bias especially struck us: bias due to attrition. This is when participants in the trial decide to leave before the studyAn investigation of a healthcare problem. There are different types of studies used to answer research questions, for example randomised controlled trials or observational studies. is over. As a result, we often don’t know what happened to these patients. Did they have a baby? Did their mental health improve, or get worse? Did they feel it is hopeless to continue psychological treatment? For example, one study showed a very large positive effect on live birth rates of two psychological interventions. In this study, patients reported the outcomeOutcomes are measures of health (for example quality of life, pain, blood sugar levels) that can be used to assess the effectiveness and safety of a treatment or other intervention (for example a drug, surgery, or exercise). In research, the outcomes considered most important are ‘primary outcomes’ and those considered less important are ‘secondary outcomes’. of their treatment by telephone. However a lot of participants left (dropped out) before the study was over, so the authors did not know whether or not they had had a baby. The results were therefore based on those participants remaining in the study rather than the full cohort. We usually assume that patients with missing results did not have a baby. In this case however, we had to apply this assumption to a substantial proportion of the participants, including the majority of those in the control group. This is clearly inappropriate.
Perhaps many of the people who didn’t provide their results did have a baby, and were no longer interested in participating in the research. A lot more patients dropped out from the control group, so in this scenario the birth rateThe speed or frequency of occurrence of an event, usually expressed with respect to time. For instance, a mortality rate might be the number of deaths per year, per 100,000 people. might have been similar or even better than for people receiving psychological treatment. A common mistake researchers make is to think that analysing the dataData is the information collected through research. of the people left in the study tells us the effect of a treatment if patients adhere to it. But this isn’t correct. From the example above, it is clear that we can’t just compare birth rates in the participants remaining in the study if a large proportion of participants have left before the study was over. There are statistical methods designed to give valid results when some data are missing, but even those won’t work when a lot is missing. The best approach is to make a great effort to keep participants in the study until the end, and to collect results from everyone.
How to pick a control group?
Which group should the patients receiving the interventionA treatment, procedure or programme of health care that has the potential to change the course of events of a healthcare condition. Examples include a drug, surgery, exercise or counselling. be compared to? The choice of control group in a clinical trial is always very important. The question answered by a study depends on the control group used. For example, one clinical trial in the review had two intervention groups and one control group. The control group received usual care. If patients receiving therapy are compared to patients receiving usual care only, then the study cannot tell us if any improvements are due to therapy per se. Any benefits may be due to the fact that patients in the therapy group received more attention than those in the control group.
If instead we make sure patients in the control group receive a similar amount of attention as those receiving therapy, we can evaluate whether or not therapy is effective over and above any placebo-type effects resulting from the expectations of the researchers and participants. In this clinical trial one intervention groupA group of people in a study receiving a particular health care intervention (for example a drug, surgery, or exercise). received emotional writing therapy (the actual intervention of interest), and the other intervention group received fact writing therapy (attentional control). In this way patients in the fact writing group would have thought that they received the intervention in which the researchers were interested.
Use of an attentional control group can therefore help to keep the participants blindedBlinding is the process of preventing those involved in a trial from knowing to which comparison group a particular participant belongs.. This might be particularly important where patient results are evaluated using questionnaires, as patients may be more inclined to report an improvement if they believe they are in the preferred group. Use of questionnaires is common in psychology research. Perhaps unsurprisingly, we would expect to see larger differences between patients receiving therapy compared to those receiving nothing at all than we would compared to an attentional control group.
Recommendations for the future
Research in the psychology is challenging due to the factors described above. Techniques to overcome these problems may be challenging to implement. However, failure to do so will lead to inappropriate conclusions. Future trials of psychological or educational interventions should be conducted to a higher methodological standard so that treatment decisions may be based on robust evidence. We hope the suggestions we have made in the review will help researchers to design better studies in the future.
Can psychological therapies help sub fertile couples? Finding the answer is harder than you think by Jolijn Verkuijlen and Jack Wilkinson is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Based on a work at http://onlinelibrary.wiley.com/doi/10.1002/14651858.CD011034.pub2/full. Images have been purchased for Evidently Cochrane from istock.com and may not be reproduced.
Links:
Psychological and educational interventions for subfertile men and women. Cochrane Database of Systematic ReviewsIn systematic reviews we search for and summarize studies that answer a specific research question (e.g. is paracetamol effective and safe for treating back pain?). The studies are identified, assessed, and summarized by using a systematic and predefined approach. They inform recommendations for healthcare and research. 2016, Issue 3. Art. No.: CD011034. DOI: 10.1002/14651858.CD011034.pub2.
, , , , .Plain language summary of the review: http://www.cochrane.org/CD011034/MENSTR_psychological-and-educational-interventions-subfertile-men-and-women