Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The DELIVER study; the impact of research capacity building on research, education, and practice in Dutch midwifery

  • Evelien Spelten ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    e.spelten@latrobe.edu.au

    Affiliation Violet Marshman Centre for Rural Health Research, Rural Health School, La Trobe University, Melbourne, Australia

  • Janneke Gitsels,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing

    Affiliations Amsterdam UMC location Vrije Universiteit Amsterdam, Midwifery Science, Amsterdam, the Netherlands, Midwifery Academy Amsterdam Groningen, InHolland, Amsterdam, the Netherlands

  • Corine Verhoeven,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing

    Affiliations Amsterdam UMC location Vrije Universiteit Amsterdam, Midwifery Science, Amsterdam, the Netherlands, Midwifery Academy Amsterdam Groningen, InHolland, Amsterdam, the Netherlands, Department of Midwifery, School of Health Sciences, University of Nottingham, Nottingham, United Kingdom, Department of Obstetrics and Gynaecology, Maxima Medical Centre, Veldhoven, the Netherlands

  • Eileen K. Hutton,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation McMaster Midwifery Research Unit, McMaster University Hamilton, Canada

  • Linda Martin

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing

    Affiliations Amsterdam UMC location Vrije Universiteit Amsterdam, Midwifery Science, Amsterdam, the Netherlands, Midwifery Academy Amsterdam Groningen, InHolland, Amsterdam, the Netherlands

Abstract

Background

Few examples exist of research capacity building (RCB) in midwifery. As in other jurisdictions, at the turn of this century midwives in the Netherlands lagged in research-based practice. Dutch professional and academic organisations recognised the need to proactively undertake RCB. This paper describes how a large national research project, the DELIVER study, contributed to RCB in Dutch midwifery.

Methods

Applying Cooke’s framework for RCB, we analysed the impact of the DELIVER study on RCB in midwifery with a document analysis comprising the following documents: annual reports on research output, websites of national organizations that might have implemented research findings, National Institute for Public Health and the Environment (RIVM)), midwifery guidelines concerning DELIVER research topics, publicly available career information of the PhD students and a google search using the main research topic and name of the researcher to look for articles in public papers.

Results

The study provided an extensive database with nationally representative data on the quality and provision of midwifery-led care in the Netherlands. The DELIVER study resulted in 10 completed PhD projects and over 60 publications. Through close collaboration the study had direct impact on education of the next generation of primary, midwifery care practices and governmental and professional bodies.

Discussion

The DELIVER study was intended to boost the research profile of primary care midwifery. This reflection on the research capacity building components of the study shows that the study also impacted on education, policy, and the midwifery profession. As such the study shows that this investment in RCB has had a profound positive impact on primary care midwifery in the Netherlands.

Introduction

In the Netherlands midwives are autonomous, medical health care practitioners who approach pregnancy and birth care from a physiological, rather than a pathological perspective [1] and have a solid reputation for delivering high quality midwife-led perinatal care. In 2019, 87% of pregnant women started their care with a midwife [2]. Despite providing care to the majority of Dutch women, all metrics of research productivity indicated that midwife-led research was largely absent prior to 2010. Thus, Dutch midwives had a limited scientific body of knowledge about critical aspects of care and evidence-based care. A lack of insight into mechanisms explaining benchmark data, such as differences in the number of medical interventions between both primary and secondary maternity care facilities, to reflect on care provision existed. Very few midwives had a postgraduate degree or would consider research as a career option. Acknowledging this hiatus, a national movement started around 2010 to invest in research capacity building (RCB) [3].

In recognition of the importance of evidence-based practice, The World Health Organisation’s (2009) [4] global standards on the education of midwives, stressed the importance of research capacity building (RCB). RCB has been defined as ’a process of individual and institutional development which leads to higher levels of skills and greater ability to perform proper research [5]. RCB programs use a variety of approaches with the most prominent examples being fellowships and internships. Programs focus on early career researchers as well as on experienced clinicians through adjunct or conjoint to promote clinical academic career paths [6, 7]. However, it is well recognised that successful RCB includes provision of, for example, a supportive research climate and infrastructure, enhancing collaborations and network building. In this context, McAllister [8] and Matus et al. [9], identified the importance of a shared rather than a top-down approach to working with novice researchers and Wenger [10] and Trostle [5] emphasised the need for flexibility and broadness in supervision. Matus et al. [9] mentioned the importance of valuing research for excellence and supporting clinicians in practice. McAllister [8] considered a community of practice as a tried and tested model. Good mentorship and knowledge exchange contribute to success of RCB, as well as interdisciplinary collaboration which requires supportive network environments, and community-based research [5, 811].

Brew et al., [1216] stressed the benefits of integrating education with RCB as this offers students a different professional perspective. Research enhanced education should start in undergraduate degrees and not keep students at arm’s length [13, 17]. Green et al. [17] reported on a case study of developing nursing and midwifery RCB as part of education moving into a university setting. The RCB developed from an initial all-inclusive approach into more leading-edge research. There was a strong convergence of teaching and research which was supported by academic leadership and educational management working in tandem [17].

Crucial to the success of RCB is the development of critical mass and allowing time for the development and embedding of research. Cooke recommends at least a 10-year timeframe before considering the actual impact of RCB efforts [18]. Time is needed to develop an academic identity in what Ennals summarises as "doing, being, becoming and belonging" [19]. Protected time, especially in a teaching environment, is singled out as one of the critical factors for RCB success and thus also failure [20]. Closely related to protected time is attention to academic writing and critical thinking, skills that take and need time to develop [11, 21]. Women experience inequity in academia and in obtaining grant funding and these challenges are intensified in nursing and midwifery where research domains are in just evolving [7, 11]. RCB should benefit education, clinical practice and the wider society and result in research that values engagement and impact with local and global issues [21, 22]. In an evaluation of a graduate midwifery research intern program Hauck et al. [7] recognised the relevance of RCB not just for clinical practice but for health care in general, through for example, contributions to policy development. Carrick-Sen et al. [6] mentioned the importance of research that improves patient outcomes, RCB is an important mechanism to improve health service delivery [6, 23]. Brew related successful RCB to the reciprocal influence of political, institutional and disciplinary factors, stating that "today’s society demands creativity and the ability to deal with complexity and uncertainty, change is endemic” [13].

Around 2010, in the Netherlands, several initiatives involving the three Midwifery Academies as well as the professional bodies of midwives and obstetricians were taken to improve RCB in midwifery. One of the initiatives was the establishment of the first university-based research department of Midwifery Science [3]. At its inception, the department, together with the teaching-based Midwifery Academy Amsterdam Groningen (AVAG), undertook the DELIVER Study (Data Eerste LIjns VERloskunde, a Dutch acronym for evidence on midwifery care), see Box 1. The aim of the DELIVER study was to contribute to evidence-based practice in primary care midwifery and to research capacity building. With the data collection for the DELIVER study ending approximately ten years ago, now seems a good time to evaluate and reflect [18]. While the primary intention of the DELIVER project was to increase research capacity and academic output, after ten years it is equally interesting to reflect on the impact the study had beyond research. The research question for this paper therefore was: how did the DELIVER study contribute to RCB in Dutch midwifery? In addition to academic output, the focus is on subsequent impact on education, midwifery practice, and the profession.

BOX 1: The DELIVER study: data collection and research capacity building

The design of the DELIVER study is described in more detail elsewhere [80, 81]. Data for the DELIVER study were collected between September 2009 and April 2011. Clients and their partners, midwives and other healthcare professionals across the Netherlands participated in the study. As a prospective cohort study, clients from twenty midwifery practices completed up to three questionnaires during their pregnancy. The client data were linked to data from the Netherlands Perinatal Register and electronic client records kept by midwives. Midwives and practice assistants from the twenty participating practices completed a questionnaire and recorded work-related activities in a diary for one week, to assess workload. Data at client, midwife and practice level were linked. Another questionnaire on the organisation of midwifery-led care was sent to all, ca. 500, Dutch midwifery practices. Additionally, partners of pregnant women and other care providers were asked about their expectations and experiences regarding the care delivered by midwives and in six practices client consults were videotaped to objectively assess daily practice.

In total, 7685 clients completed at least one questionnaire, 136 midwives and assistants completed a diary with work-related activities (response 100%), 99 midwives completed a questionnaire (92%), 30 partners of clients participated in focus groups, 21 other care providers were interviewed, 305 consults at six midwifery practices were videotaped and 319 practices across the country completed a questionnaire (61%). This extensive database lay at the heart of a 10 PhD projects, a myriad of papers and conference presentations, and impacted practice, education, xand policy.

Methods

The six principles developed by Cooke [18, 24] to evaluate RCB are [1] build skills and confidence, [2] support research that is close to practice, [3] identify linkages, collaborations and partnerships, [4] ensure appropriate dissemination and impact, [5] include elements of continuity and sustainability and [6] establish an appropriate infrastructure. The principles can be applied at an individual, team, organisational and supra-organisational level. Cooke [25] noted that measures of traditional academic outputs (such as peer reviewed publications) do not provide a complete picture, and recommends that assessment also consider social impact (e.g. health improvements), related to what we now call the engagement and impact of academic work. Using Cooke’s framework [18, 20, 24] and its application, we analysed the impact of the DELIVER study on RCB in midwifery with a document analysis comprising the following documents: annual reports on research output, websites of national organizations that might have implemented research findings (e.g. Royal Dutch Organization of Midwives (KNOV), National Institute for Public Health and the Environment (RIVM)), midwifery guidelines concerning DELIVER research topics, publicly available career information of the PhD students and a google search using the main research topic and name of the researcher to look for articles in public papers. The CVs were not publicly available, but consent was acquired prior to accessing. The outputs of the study described in the document content were coded and categorised in line with the framework’s six principles.

The design of the DELIVER study is described in more detail elsewhere [26, 27]. Data for the DELIVER study were collected between September 2009 and April 2011. Clients and their partners, midwives and other healthcare professionals across the Netherlands participated in the study. As a prospective cohort study, clients from 20 midwifery practices completed up to three questionnaires during their pregnancy. The client data were linked to data from the Netherlands Perinatal Register and electronic client records kept by midwives. Midwives and practice assistants from the twenty participating practices completed a questionnaire and recorded work-related activities in a diary for one week, to assess workload. Data at client, midwife and practice level were linked. Another questionnaire on the organisation of midwifery care was sent to all, approximately 500, Dutch midwifery practices. Additionally, partners of pregnant women and other care providers were asked about their expectations and experiences regarding the care delivered by midwives. As a final part of the DELIVER study data collection, in six practices client intake consults were videotaped to objectively assess daily practice.

In total, 7685 clients completed at least one questionnaire, 136 midwives and assistants completed a diary with work-related activities (response rate 100%), 99 midwives completed a questionnaire (response rate 92%), 30 partners of clients participated in focus groups, 21 other care providers were interviewed, 305 consults at six midwifery practices were videotaped and of the 523 practices in the country, 319 completed a questionnaire (response rate 61%). This comprised the total data set for the DELIVER study. PhD candidates were able to consider all collected data: surveys, focus groups, video recordings, depending on the relevance for their project.

The authors of this paper were actively involved with the DELIVER project and the initiatives to advance the evidence base and the professional status of midwifery. They have used their own experiences with the project to add to the narrative of this paper. ES is a psychologist and was Chief Investigator on the project and co-supervisor; JG is a midwife, she runs one of the participating practices and was one of the PhD candidates; CV is a midwife who joined the department of Midwifery Science after her PhD in 2013 where she currently leads a second research program as a follow-up to/continuation of the DELIVER study; EH is a midwife, head of a midwifery department and first Chair of the midwifery science department and principal supervisor; LM is a psychologist, a lecturer at the midwifery Academy and was one of the PhD candidates.

Ethics statement

This study is a reflection on the process of the DELIVER study and does not involve human participants, therefore no ethics approval was needed. The design and conduct of the DELIVER study were approved by the Medical Ethics Committee of the VU University Medical Centre Amsterdam.

Results

Using Cooke’s framework [18, 20, 24], we provide a description of how the RCB process was implemented followed by an account of direct research and academic output, then a summary of the impact on education and on the profession (primary through policy and practice). Findings are summarised in several tables: Table 1 provides a summary of the six principles in relation to our work. Table 2 provides a summary of the 10 PhD projects based on the DELIVER study and the related research output [2671], which were the core research part of the study. In Table 3 the network activities related to the PhD are summarised, and finally Table 4 captures the dissemination and impact of the study from 2010–2020.

thumbnail
Table 1. Research capacity building model, adapted from Cooke and complemented.

https://doi.org/10.1371/journal.pone.0287834.t001

thumbnail
Table 2. Summary of individual projects supported by the DELIVER-study (2010–2020).

https://doi.org/10.1371/journal.pone.0287834.t002

thumbnail
Table 3. Summary of research network by the PhD-projects based on the DELIVER-study.

https://doi.org/10.1371/journal.pone.0287834.t003

thumbnail
Table 4. Summary of dissemination and impact of the DELIVER-study (2010–2020).

https://doi.org/10.1371/journal.pone.0287834.t004

Academic and research outcomes

The DELIVER study provided midwives and other health care professionals such as health scientists and psychologists the opportunity to build research skills and confidence (See Table 1) by undertaking a PhD on a midwifery related topic (Table 2). All PhD theses were publication based, thereby developing academic publishing skills, and building the body of research to inform practice. PhD candidates participated in regular full day seminars led by Midwifery scientists to provide infrastructure and built a community of practice among novice researchers. Seminar topics included responding to reviewer comments, developing effective conference presentations (oral or poster), specific study methods and approaches to analyses. Participants were encouraged to bring challenges they were encountering to the group for discussion with peers, thus building on the skill set and confidence of the researchers. Since PhD students did not all start at the same time more experienced students were able to mentor novices thus moving into a supervisor-student role and building confidence throughout the process on different levels. In addition, each PhD candidate needed to attain 30 European Credits from trainings programs tailored to individual competencies and learning objectives as well to more general requirements, such as a scientific integrity course. The PhD candidates independently selected their research topic, which contributed to their motivation and completion. They used the DELIVER data set augmented with additional data collection if needed. The project team of the DELIVER study supervised PhD candidates to complete their thesis work according to university standards and navigated additional research training and research time needs as necessary, thus establishing an appropriate infrastructure. Both the midwifery academy and the midwifery practice provided protected time for the lecturers and the practising midwife to work on their PhD to ensure timely completion. The midwifery academy Amsterdam Groningen (AVAG) funded nine projects; the Royal Dutch Organisation for Midwives (KNOV) funded the tenth project (project 3). The supervisory teams of 8 of the 10 candidates included professors from other organizations, such as other, non-Dutch, universities, or health services research institutes (projects 2–7, 9, 10). This provided the PhD candidates with linkages to professionals to facilitate their research careers within and outside midwifery science.

As part of the DELIVER project, an interdisciplinary advisory panel including midwives, obstetricians, medical doctors, health scientists and psychologists enhanced networking, linkages, and collaboration. The design of the DELIVER study was modelled on the Dutch National Study on Diseases and Interventions in General Practice using, where relevant, the same set of validated questionnaires, which added to the validity of the study. Additional questions, for example about pain management in labour and prenatal anomaly screening, were added based on specific midwifery context, aligning with Cooke’s notion of the research being close to practice [3337, 5053].

Table 2 identified the 10 PhD projects that were part of the DELIVER project, as well as described the career development of the PhD candidates. An important outcome was that all 10 PhD candidates completed their PhD program; three of them while working as a lecturer at the Midwifery Academy Amsterdam Groningen, one combined her PhD project with working in a midwifery practice; three candidates worked full-time on their project, and two worked full-time as a researcher on both the DELIVER-study as well as their PhD project. One PhD-candidate was a DELIVER study project leader, she co-authored over 10 DELIVER papers (project 6). Four PhD candidates used the video-recordings as part of their project (Table 2: video analysis). Additionally, the DELIVER study facilitated four established researchers in their research careers by publishing manuscripts in peer-reviewed journals (n = 7) and attending (international) conferences [3, 26, 27, 7275]. As summarised in Table 2, the DELIVER study’s 10 PhD projects contributed significantly to the scientific output of the study, with a total of 43 peer-reviewed internationally published papers, thus ensuring appropriate dissemination and impact. Furthermore, the DELIVER studies resulted in ongoing robust collaboration network that for instance facilitates new research projects and dissemination of research findings (Table 3). And finally, the results of the different PhD-projects of the DELIVER study were disseminated in national professional journals, national media, and national conferences and international conferences.

Five out of ten PhD graduates received a post-doc position (projects 2–4,6,7); of whom one received a postdoctoral fellowship of the professional association (project 3). Two individuals became researchers at other universities, one in the Netherlands and one in another country (projects 1,5). Four combined post-doc positions with a role as a lecturer while one combined the post-doc position with practising midwifery. Two researchers did not continue in research; however, they were able to disseminate the results of their projects in education in their function as lecturers in the midwifery academies (projects 8,10). See also table 2.

Education

The DELIVER study was an initiative of one of the Midwifery Academies, under the auspices of the Professional Midwifery Education Foundation.

The Midwifery Academy Amsterdam Groningen (AVAG) initiated the study, and five of their lecturers (comprising 14% of all lecturers) undertook PhD study (projects 2,4,6,7,9) which provide excellent opportunities for interaction with practice as well as with education. These lecturers demonstrated to both colleagues and students the relevance of research and evidence-based working and verified that research could be a career option for midwives. Students were involved with explorative analyses during their research internships, and some participated in the DELIVER study as research assistants, e.g., through transcription of interviews, supporting symposia and workshops. Published papers were discussed in Journal clubs and students participated in research meetings. To ensure continuity for the DELIVER study, the Midwifery Academy invested in a program of Masters-funding to encourage and support midwives to undertake a master’s degree [30].

Midwifery practice.

Midwives of 20 midwifery practices, a representative sample of all practices in the Netherlands participated in the study, thus supporting research that is close to practice [26]. These midwives advised the research team about relevant research topics and during the study they were engaged to provide feedback on research findings to guarantee that the research findings were interpreted using a practice lens. The selection of PhD topic was related to practice experience of the midwives involved, e.g., prevention of infectious diseases, pain management, the determinants of midwifery care utilization, and counselling for prenatal anomaly screening.

The collaborative approach to the research promoted reciprocity among participating midwives and researchers. For instance, the video recordings of consultations to discuss prenatal anomaly screening were used to enhance consultations skills among participating midwives. This method was relatively new to them. For most midwives, it was the first time they had seen themselves in action and it was the first time they received this kind of feedback on their work practice. Dissemination of findings in workshops and training, allowed for direct translation of research results into practice.

Since the introduction of the RCB intervention students have learned to include scientific evidence in practice, resulting in midwifery practices feeling comfortable seeking evidence and using an evidence-based approach. The ensuing established Masters Fund of AVAG has resulted in an increase of midwives with a master’s degree in midwifery practices and a close educational collaboration with the Masters’ Course Evidence Based Practice in Health Care (University of Amsterdam), Midwifery undergraduate students can choose to do a pre-master program there, allowing for easier access to a Masters program.

The profession

One of the broader impacts on the profession was the building of linkages, collaborations and partnerships, which helped to establish an appropriate infrastructure to ensure continuity and sustainability of research. While these partnerships may have started as research collaboration, they impacted on both education and the profession as well. The DELIVER study and the establishment of the first Dutch University based Department of Midwifery Science (e.g., multidisciplinary academic research group on midwifery) was part of a national incentive to improve evidence-based practice for primary care midwifery. The chair for the Department was recruited from Canada, which broadened international collaboration (e.g. peer-reviewed papers from an international team of authors; student-exchange program) and perspective (e.g. encouragement of international cooperation in research and education).

Table 3 summarises the networks based on or arising from the PhD projects. Through the DELIVER study, nationally, the Department of Midwifery Science was embedded and linked not only to one of the midwifery academies and the university but also to the Netherlands Institute for Health Services Research (Nivel) and policy through meetings with and provision of research scholarships by the Royal Dutch Organization of Midwives (KNOV) and the National Institute for Public Health and the Environment from the Ministry of Health, Welfare and Sport (RIVM). By collaborating in the establishment of the Midwifery Research Network Netherlands [76], collaboration with the other two Dutch midwifery academies and their research initiatives was improved as well as expanded.

Furthermore, results led to policy changes such as revised guidelines around quality of care on for example pain management, prevention of infectious diseases, and counselling for prenatal anomaly screening. And as a final major milestone, the DELIVER study contributed greatly to the establishment of the first Dutch primary care midwifery chair with a Dutch midwife as a professor.

The 10 PhD projects contributed to the midwifery science department becoming a well-recognised player in both the field of midwifery research and the academic world, now with four associate professors and a full professor in Midwifery since 2019. The department has a sustainable infrastructure enabling effective running of research projects. This, in turn, contributes to the sustainability of the midwifery research department and ensures a supportive environment for new PhD students.

The results of the DELIVER study have also contributed to the establishment of the Childbirth Network [https://www.childbirthnetwork.nl/]. The aim of the Childbirth Network is to connect midwifery practice, education, and research. A website has been developed where pregnant women and midwives can find evidence-based information. Next to this, a network of academic midwifery practices has been established. Within the Childbirth Network, six new research projects have started. The scientific work is informing practice and education by establishing a body of evidence. And equally, practice informs research by collecting data and contributing important research questions. In collaboration with Midwifery Academy Maastricht the Dutch Midwifery Case Registration System (VeCaS) was established. This system includes routinely collected data from electronic primary midwifery care registration systems used by Dutch Midwifery care practices across the Netherlands, and is part of the Childbirth Network [77].

Midwives participating in the network of academic practices had the impression that more women opted for a home birth during the COVID-19 pandemic. As an example of practice-based research, researchers from the midwifery science department then decided to examine this impression by researching the course of pregnancy and birth of low-risk women who started their care in primary midwifery care, and the accompanying maternal and neonatal health outcomes differed during the first wave of the COVID-19 pandemic (2020) compared to the pre-pandemic period (2019), using the VeCaS data. The conclusion of this research project was that compared to the pre-pandemic period, during the pandemic there was indeed a higher rate of planned and actual home birth among low-risk pregnant women in the Netherlands [78].

Discussion

Main findings

The well-designed multicentre multidisciplinary prospective DELIVER study was a well-thought-out investment designed to boost research in midwifery-led care. The study provided an extensive database with nationally representative data on the quality and provision of midwifery-led care in the Netherlands [25, 27, 79]. The study was undertaken at a time when there was a widespread initiative to improve the academic profile of primary care midwifery with extended impact on education and midwifery practice and policy. The DELIVER study resulted in 10 completed PhD projects and over 60 academic publications. The study had a direct impact on the education of the next generation of midwives and on midwifery practice and the profession. Close collaboration with primary midwifery care practices and governmental and professional bodies, allowed for direct translation and dissemination of research results.

Interpretation of findings

  1. 1. Academic impact.

The RCB impact of the DELIVER study can be highlighted at a number of levels.

The direct academic output was substantial, all PhD projects consisted of a collection of published and peer-reviewed papers, published in high-ranking academic journals. The PhD projects were an integral part of the study with the number gradually increasing from 4 to 10. Because PhD candidates independently selected their topic of research, there was wide variation in topic, study design and output.

The department of Midwifery Science has made a professional impact and is now headed by a professor of Midwifery and has become an important and influential department within the university.

  1. 2. Impact beyond academia: education, practice and policy.

Education. The Midwifery Academy inspired and initiated this RCB project. It allowed for lecturers integrating their own research into their classes, and lecturers being role models for students and colleagues. The integrated infrastructure with the new University Department of Midwifery Sciences ensured continuation and easy access to a research environment.

Students directly experienced the importance of an evidence- based approach to practice and these experiences may have provided the catalyst for their future involvement with research.

Practice. Twenty midwifery practices and 119 midwives were actively involved in the study. Midwives involved in the video study received feedback on their work practice as a form of continuous professional development. The practices were spread over the Netherlands which allowed for signalling of differences between regions and national outcomes, on topics such as prenatal screening uptake. The spread allowed for national exposure of practising midwives to research and contributed to the normalisation of participating in research. PhD-midwives experienced increased professional respect from colleagues and a more equal position with obstetricians for example in joint research projects, both national and internationally. In addition, there are continuing professional workshops and seminars and attendance at conferences where findings relevant to clinical practice are presented.

Policy. The projects contributed to policy development for example on infectious diseases, labour pain management and counselling for prenatal anomaly screening and one PhD-midwife has become an expert in the Medical Disciplinary Committee for midwifery and obstetrics conflict assessor in Midwifery Policy, as well as a member of the research committee Pregnancy and Childbirth ZonMw (The Netherlands Organisation for Health Research and Development)

Through the DELIVER study, the Department of Midwifery Science was established, the department secured a seat at relevant tables. This improved the standing of the profession and strengthened the voice of primary care midwifery.

  1. 3. Reflecting on RCB.

In this paper, we retrospectively looked at the impact of the DELIVER study on RCB in primary care midwifery. The Cooke framework provided an excellent structure to support our reflection, 10 years on and allowed reflection on and analysis of the impact of the DELIVER study. An obvious recommendation for future research is incorporating the full range of aspects of RCB prospectively. More traditional aspects of evaluation such as academic publications are already documented automatically through systems such as ORCID. However other RCB characteristics, often relating to the increasingly important impact of research, are less easily determined retrospectively and would benefit from prospective data collection.

Limitations and strengths

A limitation of this reflection was the reliance on our own reflections which may have colored the results or left out aspects of RCB, given the time that has passed since the start of the study. For example, we may have been unaware of the impact of the DELIVER study on certain policy documents. Equally, we may have underestimated the impact of our output by following the Cooke model and not including for example analysis using SciVal or similar platforms. When considering all aspects of RCB, any future study should not only include close collaboration with practices and professionals, but should more strongly include the voice of consumers, pregnant women and their partners, in the whole research trajectory, as is being established now in the Childbirth Network. A strength of this reflection is that the authors were and are directly involved in primary care midwifery in multiple roles and witnessed the impact of this RCB process over the 10 years since the start of the study.

Conclusion

The well-designed multicentre multidisciplinary prospective DELIVER study was a considered investment to boost research in midwifery-led care. This reflection considered this investment on all research capacity building components and demonstrated that the study also impacted on education, policy and the midwifery profession. As such the study shows that this considered investment in RCB has had a profound positive impact on positioning primary care midwifery, now and in the future.

References

  1. 1. Zondag L, Cadee F, De Geus M. Midwifery in The Netherlands. 2017.
  2. 2. Perined. Perinatale zorg in Nederland anno 2019—Landelijke perinatale cijfers en duiding (Prenatal care in the Netherlands 2019—National stats). Utrecht, Netherlands; 2020.
  3. 3. Spelten E, Nieuwenhuijze M. Midwifery Research in the Netherlands Gaining Momentum. International Journal of Childbirth. 2013;3(4):195–202.
  4. 4. World Health Organization. Global standards for the initial education of professional nurses and midwives. Geneva, Switzerland, Health DoHRf; 2009.
  5. 5. Trostle J. Research capacity building in international health: definitions, evaluations and strategies for success. Social science & medicine. 1992;35(11):1321–4. pmid:1462171
  6. 6. Carrick-Sen D, Moore A, Davidson P, Gendong H, Jackson D. International perspectives of nurses, midwives and allied health professionals clinical academic roles: Are we at tipping point? International Journal of Practice-Based Learning in Health and Social Care. 2019.
  7. 7. Hauck YL, Lewis L, Bayes S, Keyes L. Research capacity building in midwifery: case study of an Australian graduate midwifery research intern programme. Women and Birth. 2015;28(3):259–63. pmid:25773669
  8. 8. McAllister M, Brien DL. ‘Pre-run, Re-run’: An innovative research capacity building exercise. Nurse education in practice. 2017;27:144–50. pmid:28892728
  9. 9. Matus J, Walker A, Mickan S. Research capacity building frameworks for allied health professionals–a systematic review. BMC health services research. 2018;18(1):1–11.
  10. 10. Wenger EC, Snyder WM. Communities of practice: The organizational frontier. Harvard business review. 2000;78(1):139–46.
  11. 11. Ryan MM, Yeung RS, Bass M, Kapil M, Slater S, Creedon K. Developing research capacity among graduate students in an interdisciplinary environment. Higher Education Research & Development. 2012;31(4):557–69.
  12. 12. Brew A. Teaching and research: New relationships and their implications for inquiry-based teaching and learning in higher education. Higher Education Research & Development. 2003;22(1):3–18.
  13. 13. Brew A. Imperatives and challenges in integrating teaching and research. Higher Education Research & Development. 2010;29(2):139–50.
  14. 14. Brew A, Boud D, Malfroy J. The role of research education coordinators in building research cultures in doctoral education. Higher Education Research & Development. 2017;36(2):255–68.
  15. 15. Begley C, McCarron M, Huntley-Moore S, Condell S, Higgins A. Successful research capacity building in academic nursing and midwifery in Ireland: An exemplar. Nurse Education Today. 2014;34(5):754–60. pmid:24156983
  16. 16. Robertson J, Blackler G. Students’ experiences of learning in a research environment. Higher Education Research & Development. 2006;25(3):215–29.
  17. 17. Green B, Segrott J, Hewitt J. Developing nursing and midwifery research capacity in a university department: case study. Journal of Advanced Nursing. 2006;56(3):302–13. pmid:17042809
  18. 18. Cooke J. A framework to evaluate research capacity building in health care. BMC Family practice. 2005;6(1):1–11.
  19. 19. Ennals P, Fortune T, Williams A, D’Cruz K. Shifting occupational identity: Doing, being, becoming and belonging in the academy. Higher Education Research & Development. 2016;35(3):433–46.
  20. 20. Fullam J, Cusack E, Nugent LE. Research excellence across clinical healthcare: a novel research capacity building programme for nurses and midwives in a large Irish region. Journal of Research in Nursing. 2018;23(8):692–706. pmid:34394491
  21. 21. Cronshaw D. Re-valuing research in theological education. Higher Education Research & Development. 2020;39(1):53–66.
  22. 22. Kelly WB, MacDermott S, Spelten E. A seat at the table: Regional, rural and remote health research and impact. Australian Journal of Rural Health. 2021. pmid:34658082
  23. 23. Wright D, Fry M, Adams J, Bowen C. Building research capacity in musculoskeletal health: qualitative evaluation of a graduate nurse and allied health professional internship programme. BMC health services research. 2020;20(1):1–10. pmid:32799869
  24. 24. Cooke J, Nancarrow S, Dyas J, Williams M. An evaluation of the’Designated Research Team’approach to building research capacity in primary care. BMC Family Practice. 2008;9(1):1–12.
  25. 25. Kelly W. Navigating Pathways to Community: Exploring the Experiences of Community-Engaged Humanities and Social Science Academics: Swinburne University of Technology; 2019.
  26. 26. Mannien J, Klomp T, Wiegers T, Pereboom M, Brug J, De Jonge A, et al. Evaluation of primary care midwifery in the Netherlands: Design and rationale of a dynamic cohort study (DELIVER). BMC Health Services Research. 2012;12(1). pmid:22433820
  27. 27. Spelten ER, Martin L, Gitsels JT, Pereboom MTR, Hutton EK, van Dulmen S. Introducing video recording in primary care midwifery for research purposes: Procedure, dataset, and use. Midwifery. 2015;31(1):95–102. pmid:25037442
  28. 28. Pereboom MT, Spelten ER, Manniën J, Rours GIJ, Morré SA, Schellevis FG, et al. Knowledge and acceptability of Chlamydia trachomatis screening among pregnant women and their partners; A cross-sectional study. BMC Public Health. 2014;14(1). pmid:25011479
  29. 29. Pereboom MTR, Manniën J, Rours GIJG, Spelten ER, Hutton EK, Schellevis FG. Chlamydia trachomatis infection during pregnancy: Knowledge, test practices, and attitudes of Dutch midwives. Scandinavian Journal of Infectious Diseases. 2014;46(2):107–13. pmid:24350790
  30. 30. Pereboom MTR, Manniën J, Spelten ER, Hutton EK, Schellevis FG. Maternal cytomegalovirus infection prevention: The role of Dutch primary care midwives. Midwifery. 2014;30(12):1196–201. pmid:24832932
  31. 31. Pereboom MTR, Manniën J, Spelten ER, Schellevis FG, Hutton EK. Observational study to assess pregnant women’s knowledge and behaviour to prevent toxoplasmosis, listeriosis and cytomegalovirus. BMC Pregnancy and Childbirth. 2013;13.
  32. 32. Pereboom MTR, Manniën J, van Almkerk KDJ, Spelten ER, Gitsels JT, Martin L, et al. What information do Dutch midwives give clients about toxoplasmosis, listeriosis and cytomegalovirus prevention? An exploratory study of videotaped consultations. Patient Education and Counseling. 2014;96(1):29–35. pmid:24820638
  33. 33. Martin L, Gitsels-van der Wal JT, Pereboom MTR, Spelten ER, Hutton EK, van Dulmen S. Midwives’ perceptions of communication during videotaped counseling for prenatal anomaly tests: How do they relate to clients’ perceptions and independent observations? Patient Education and Counseling. 2015;98(5):588–97. pmid:25727285
  34. 34. Martin L, Gitsels-van der Wal JT, Pereboom MTR, Spelten ER, Hutton EK, van Dulmen S. Clients’ psychosocial communication and midwives’ verbal and nonverbal communication during prenatal counseling for anomaly screening. Patient Education and Counseling. 2016;99(1):85–91. pmid:26298217
  35. 35. Martin L, Hutton EK, Gitsels-van der Wal JT, Spelten ER, Kuiper F, Pereboom MTR, et al. Antenatal counselling for congenital anomaly tests: An exploratory video-observational study about client-midwife communication. Midwifery. 2015;31(1):37–46. pmid:24861671
  36. 36. Martin L, Hutton EK, Spelten ER, Gitsels-Van der Wal JT, Van Dulmen S. Midwives’ views on appropriate antenatal counselling for congenital anomaly tests: Do they match clients’ preferences? Midwifery. 2014;30(6):600–9. pmid:24100043
  37. 37. Martin L, Van Dulmen S, Spelten E, De Jonge A, De Cock P, Hutton E. Prenatal counseling for congenital anomaly tests: Parental preferences and perceptions of midwife performance. Prenatal Diagnosis. 2013;33(4):341–53. pmid:23447385
  38. 38. Gitsels-van der Wal JT, Martin L, Manniën J, Verhoeven P, Hutton EK, Reinders HS. Antenatal counselling for congenital anomaly tests: Pregnant Muslim Moroccan women’s preferences. Midwifery. 2015;31(3):e50–e7. pmid:25637462
  39. 39. Gitsels-van der Wal JT, Martin L, Manniën J, Verhoeven P, Hutton EK, Reinders HS. A qualitative study on how Muslim women of Moroccan descent approach antenatal anomaly screening. Midwifery. 2015;31(3):e43–e9. pmid:25592301
  40. 40. Gitsels—van der Wal JT, Verhoeven PS, Manniën J, Martin L, Reinders HS, Spelten E, et al. Factors affecting the uptake of prenatal screening tests for congenital anomalies; a multicentre prospective cohort study. BMC Pregnancy and Childbirth. 2014;14(1).
  41. 41. Gitsels-van der Wal JT, Manniën J, Ghaly MM, Verhoeven PS, Hutton EK, Reinders HS. The role of religion in decision-making on antenatal screening of congenital anomalies: A qualitative study amongst Muslim Turkish origin immigrants. Midwifery. 2014;30(3):297–302. pmid:23726134
  42. 42. Gitsels-van der Wal JT, Manniën J, Gitsels LA, Reinders HS, Verhoeven PS, Ghaly MM, et al. Prenatal screening for congenital anomalies: Exploring midwives’ perceptions of counseling clients with religious backgrounds. BMC Pregnancy and Childbirth. 2014;14(1). pmid:25037919
  43. 43. Boerleider AW, Manniën J, van Stenus CMV, Wiegers TA, Feijen-de Jong EI, Spelten ER, et al. Explanatory factors for first and second-generation non-western women’s inadequate prenatal care utilisation: A prospective cohort study. BMC Pregnancy and Childbirth. 2015;15(1). pmid:25895975
  44. 44. Feijen-De Jong EI, Jansen DE, Baarveld F, Van Der Schans CP, Schellevis FG, Reijneveld SA. Determinants of late and/or inadequate use of prenatal healthcare in high-income countries: A systematic review. European Journal of Public Health. 2012;22(6):904–13. pmid:22109988
  45. 45. Boerleider A, Manniën J, Wiegers T, Francke A, Devillé W. Factors explaining inadequate prenatal care utilization by first and second generation non-western women in The NetherlandsAgatha Boerleider. European Journal of Public Health. 2013;23(suppl_1).
  46. 46. Boerleider AW, Francke AL, Manniën J, Wiegers TA, Devillé WLJM. "A mixture of positive and negative feelings": A qualitative study of primary care midwives’ experiences with non-western clients living in the Netherlands. International Journal of Nursing Studies. 2013;50(12):1658–66. pmid:23721761
  47. 47. Boerleider AW, Francke AL, Van De Reep M, Manniën J, Wiegers TA, Devillé WLJM. "Being flexible and creative": A qualitative study on maternity care assistants’ experiences with non-western immigrant women. PLoS ONE. 2014;9(3). pmid:24622576
  48. 48. Boerleider AW, Wiegers TA, Manniën J, Francke AL, Devillé WLJM. Factors affecting the use of prenatal care by non-western women in industrialized western countries: A systematic review. BMC Pregnancy and Childbirth. 2013;13. pmid:23537172
  49. 49. Feijen-de Jong EI, Jansen DEMC, Baarveld F, Boerleider AW, Spelten E, Schellevis F, et al. Determinants of prenatal health care utilisation by low-risk women: A prospective cohort study. Women and Birth. 2015;28(2):87–94. pmid:25682444
  50. 50. Klomp T, de Jonge A, Hutton EK, Hers S, Lagro-Janssen ALM. Perceptions of labour pain management of Dutch primary care midwives: A focus group study. BMC Pregnancy and Childbirth. 2016;16(1). pmid:26775154
  51. 51. Klomp T, de Jonge A, Hutton EK, Lagro-Janssen ALM. Dutch women in midwife-led care at the onset of labour: Which pain relief do they prefer and what do they use? BMC Pregnancy and Childbirth. 2013;13. pmid:24325387
  52. 52. Klomp T, Manniën J, De Jonge A, Hutton EK, Lagro-Janssen ALM. What do midwives need to know about approaches of women towards labour pain management? A qualitative interview study into expectations of management of labour pain for pregnant women receiving midwife-led care in the Netherlands. Midwifery. 2014;30(4):432–8. pmid:23790961
  53. 53. Klomp T, van Poppel M, Jones L, Lazet J, Di Nisio M, Lagro-Janssen AL. Inhaled analgesia for pain management in labour. Cochrane database of systematic reviews (Online). 2012;9. pmid:22972140
  54. 54. Warmelink JC, Hoijtink K, Noppers M, Wiegers TA, de Cock TP, Klomp T, et al. An explorative study of factors contributing to the job satisfaction of primary care midwives. Midwifery. 2015;31(4):482–8. pmid:25600327
  55. 55. Warmelink JC, Wiegers TA, de Cock TP, Spelten ER, Hutton EK. Career plans of primary care midwives in the Netherlands and their intentions to leave the current job. Human Resources for Health. 2015;13(1). pmid:25957893
  56. 56. Wiegers TA, Warmelink JC, Spelten ER, Klomp T, Hutton EK. Work and workload of dutch primary care midwives in 2010. Midwifery. 2014;30(9):991–7. pmid:24074733
  57. 57. Warmelink JC, de Cock TP, Combee Y, Rongen M, Wiegers TA, Hutton EK. Student midwives’ perceptions on the organisation of maternity care and alternative maternity care models in the Netherlands-a qualitative study. BMC pregnancy and childbirth. 2017;17(1):1–10.
  58. 58. Warmelink JC, Wiegers TA, de Cock TP, Klomp T, Hutton EK. Collaboration of midwives in primary care midwifery practices with other maternity care providers. Midwifery. 2017;55:45–52. pmid:28926751
  59. 59. Baron R, Manniën J, de Jonge A, Heymans MW, Klomp T, Hutton EK, et al. Socio-Demographic and Lifestyle-Related Characteristics Associated with Self-Reported Any, Daily and Occasional Smoking during Pregnancy. PLoS ONE. 2013;8(9). pmid:24019956
  60. 60. Baron R, Manniën J, te Velde SJ, Klomp T, Hutton EK, Brug J. Socio-demographic inequalities across a range of health status indicators and health behaviours among pregnant women in prenatal primary care: A cross-sectional study. BMC Pregnancy and Childbirth. 2015;15(1). pmid:26463046
  61. 61. Baron R, Martin L, Gitsels-van der Wal JT, Noordman J, Heymans MW, Spelten ER, et al. Health behaviour information provided to clients during midwife-led prenatal booking visits: findings from video analyses. Midwifery. 2017;54:7–17. pmid:28780476
  62. 62. Baron R, Te Velde SJ, Heymans MW, Klomp T, Hutton EK, Brug J. The relationships of health behaviour and psychological characteristics with spontaneous preterm birth in nulliparous women. Maternal and child health journal. 2017;21(4):873–82. pmid:27581004
  63. 63. Baas CI, Erwich JJHM, Wiegers TA, de Cock TP, Hutton EK. Women’s Suggestions for Improving Midwifery Care in The Netherlands. Birth. 2015;42(4):369–78. pmid:26467657
  64. 64. Baas CI, Wiegers TA, de Cock P, Erwich JJHM, Spelten ER, de Boer MR, et al. Client-related factors associated with a "less than good" experience of midwifery care during childbirth in the Netherlands. Birth: Issues in Perinatal Care. 2017;44(1):58–67. pmid:27905662
  65. 65. Baas CI, Wiegers TA, de Cock TP, Erwich JJHM, Spelten ER, Hutton EK. Experience with and amount of postpartum maternity care: Comparing women who rated the care they received from the maternity care assistant as ‘good’ or ‘less than good care’. Midwifery. 2017;55:128–36. pmid:29024880
  66. 66. Westerneng M, De Cock P, Spelten ER, Honig A, Hutton EK. Factorial invariance of pregnancyspecific anxiety dimensions across nulliparous and parous pregnant women. Journal of Health Psychology. 2015;20(2):164–72. pmid:24058121
  67. 67. Westerneng M, de Jonge A, van Baar AL, Witteveen AB, Jellema P, Paarlberg KM, et al. The effect of offering a third‐trimester routine ultrasound on pregnancy‐specific anxiety and mother‐to‐infant bonding in low‐risk women: A pragmatic cluster‐randomized controlled trial. Birth. 2022;49(1):61–70. pmid:34288070
  68. 68. Westerneng M, Diepeveen M, Witteveen AB, Westerman MJ, Van Der Horst HE, Van Baar AL, et al. Experiences of pregnant women with a third trimester routine ultrasound–a qualitative study. BMC pregnancy and childbirth. 2019;19(1):1–10.
  69. 69. Westerneng M, Witteveen AB, Warmelink JC, Spelten E, Honig A, de Cock P. Pregnancy-specific anxiety and its association with background characteristics and health-related behaviors in a low-risk population. Comprehensive Psychiatry. 2017;75:6–13. pmid:28279817
  70. 70. Feijen-De Jong EI, Baarveld F, Jansen DE, Ursum J, Reijneveld SA, Schellevis FG. Do pregnant women contact their general practitioner? A register-based comparison of healthcare utilisation of pregnant and non-pregnant women in general practice. BMC Family Practice. 2013;14. pmid:23324253
  71. 71. Feijen-de Jong EI, Jansen DEMC, Baarveld F, Spelten E, Schellevis F, Reijneveld SA. Determinants of use of care provided by complementary and alternative health care practitioners to pregnant women in primary midwifery care: A prospective cohort study. BMC Pregnancy and Childbirth. 2015;15(1). pmid:26104413
  72. 72. de Cock TP, Manniën J, Geerts C, Klomp T, de Jonge A. Exclusive breastfeeding after home versus hospital birth in primary midwifery care in the Netherlands. BMC Pregnancy and Childbirth. 2015;15(1). pmid:26463347
  73. 73. Geerts CC, Klomp T, Lagro-Janssen ALM, Twisk JWR, van Dillen J, de Jonge A. Birth setting, transfer and maternal sense of control: Results from the DELIVER study. BMC Pregnancy and Childbirth. 2014;14(1). pmid:24438469
  74. 74. Manniën J, De Jonge A, Cornel MC, Spelten E, Hutton EK. Factors associated with not using folic acid supplements preconceptionally. Public Health Nutrition. 2013;17(10):2344–50. pmid:24107718
  75. 75. Geerts CC, Van Dillen J, Klomp T, Lagro-Janssen AL, De Jonge A. Satisfaction with caregivers during labour among low risk women in the Netherlands: the association with planned place of birth and transfer of care during labour. BMC pregnancy and childbirth. 2017;17(1):1–10.
  76. 76. Midwifery Research Network Netherlands (MRNN). About MRNN 2022 [Available from: https://www.kennispoort-verloskunde.nl/mrnn/about-mrnn/.
  77. 77. Pouwels A, Offerhaus P, Merkx A, Zeegers B, Nieuwenhuijze M. Detailed registration of care in midwifery practices in the Netherlands: an opportunity for research within a healthy pregnant population. BMC Pregnancy and Childbirth. 2020;20(1):1–7. pmid:32546154
  78. 78. Verhoeven CJ, Boer J, Kok M, Nieuwenhuijze M, de Jonge A, Peters LL. More home births during the COVID‐19 pandemic in the Netherlands. Birth. 2022. pmid:35554962
  79. 79. Klomp T, Spelten E, van der Meijde M. DELIVER, een studie naar de eerstelijns verloskundige zorg in Nederland [DELIVER, a study into primary care midwifery in the Netherlands]. Tijdschr voor Verloskund. 2008;7:42–3.
  80. 80. Manniën J., Klomp T., Wiegers T., Pereboom M., Brug J., De Jonge A., Van Der Meijde M., Hutton E., Schellevis F., &Spelten E. (2012). Evaluation of primary care midwifery in the Netherlands: Design and rationale of a dynamic cohort study (DELIVER) [Article]. BMC Health Services Research, 12(1), Article 69. https://doi.org/10.1186/1472-6963-12-69
  81. 81. Spelten E. R., Martin L., Gitsels J. T., Pereboom M. T. R., Hutton E. K., &van Dulmen S. (2015). Introducing video recording in primary care midwifery for research purposes: Procedure, dataset, and use [Article]. Midwifery, 31(1), 95–102. https://doi.org/10.1016/j.midw.2014.06.007