Studies โบ Methodology ยท Last reviewed 2026-05-16
Methodological criticism
Summary
Peer-reviewed criticism of the Dutch evidence base focuses on, among other things: (1) the small number of observations and incommensurable measures of gender dysphoria (Biggs), (2) the selection of successful cases, the reversal of the questionnaire and the concomitant psychotherapy (Abbruzzese et al.), and (3) the limited applicability to the current group of young people (Abbruzzese et al.). Levine et al. also argue that a proper informed consent process is needed. The main authors are Biggs (2022, 2023), Levine et al. (2022) and Abbruzzese et al. (2023).
1. Michael Biggs (Oxford, 2022 / 2023)
Biggs published in 2022 an overview of the history of puberty suppression and an assessment of the evidence for it, including de Vries 2011 and de Vries 2014, in Journal of Sex & Marital Therapy.1 Main points:
- The main evidence came from one longitudinal study of 70 adolescents; the outcomes shortly after surgery appeared positive, except for the one patient who died, but rested on a small number of observations (source).
- The measures of gender dysphoria were not comparable with each other.
- A replication study in Britain found no improvement; some effects, such as on bone density, have been carefully studied, others, such as on sexual functioning, have been ignored.
See also /evaluations/biggs-puberty-blocker-overview/ for his full publication overview.
2. Stephen Levine, E. Abbruzzese, Julia Mason (2022)
In Journal of Sex & Marital Therapy, Levine, Abbruzzese and Mason argue that the interventions for young people rest on very low-quality evidence and that a proper informed consent process is needed; they also discuss the limitations of the Dutch studies (source).2 Their full work is summarised at /evaluations/levine-critiques/.
3. Abbruzzese, Levine, Mason (2023) โ "Generalisability"
In a follow-up article the authors call the two Dutch studies methodologically flawed: the selection of participants ensured that only the most successful cases were included in the results, the reported resolution of gender dysphoria was, in their view, due to the reversal of the questionnaire used, and the concomitant psychotherapy made it impossible to separate its effects from those of hormones and surgery. They also write that the protocol is not applicable to the current group of young people, who more often develop distress only in puberty, more often have psychiatric problems and are mainly natal females (source).3
4. NICE and the Cass Review
The NICE reviews (2020) rated all results on puberty blockers and cross-sex hormones as very low certainty (source). The University of York systematic review for the Cass Review (2024) concluded that no conclusions can be drawn about the effect of puberty blockers on gender dysphoria and mental health (source).4
See also
- Criticised studies: de Vries 2011, de Vries 2014
- Specific criticism per author: Biggs, Levine et al.
- Attrition analysis: Sample size and attrition
- Replication problems: Replication attempts
- Systematic evaluations: Cass Review, SBU
- Broader debate: Scientific criticism
- People register โ Biggs, Levine, Abbruzzese, Mason, Bewley.
- Timeline โ criticism publications in chronology.
- Original publications โ full bibliography.
- FAQ ยท Glossary.
Footnotes
- Biggs M. The Dutch Protocol for juvenile transsexuals: origins and evidence. J Sex Marital Ther. 2023;49(4):348โ68.
- Levine SB, Abbruzzese E, Mason JW. Reconsidering informed consent for trans-identified children, adolescents, and young adults. J Sex Marital Ther. 2022;48(7):706โ27.
- Abbruzzese E, Levine SB, Mason JW. The myth of "reliable research" in pediatric gender medicine. J Sex Marital Ther. 2023;49(6):673โ99.
- NICE. Evidence review: gonadotrophin releasing hormone analogues for children and adolescents with gender dysphoria. October 2020.