Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Nationwide implementation of the non-invasive prenatal test: Evaluation of a blended learning program for counselors

  • Linda Martin ,

    Contributed equally to this work with: Linda Martin, Janneke T. Gitsels-van der Wal

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Project administration, Writing – original draft, Writing – review & editing

    linda.martin@inholland.nl

    Affiliation Amsterdam UMC, Vrije Universiteit Amsterdam, Midwifery Science, AVAG, Amsterdam, The Netherlands

  • Janneke T. Gitsels-van der Wal ,

    Contributed equally to this work with: Linda Martin, Janneke T. Gitsels-van der Wal

    Roles Conceptualization, Writing – review & editing

    Affiliation Amsterdam UMC, Vrije Universiteit Amsterdam, Midwifery Science, AVAG, Amsterdam, The Netherlands

  • Caroline J. Bax,

    Roles Conceptualization, Writing – review & editing

    Affiliation Amsterdam UMC, University of Amsterdam, Dept of Obstetrics, Amsterdam, The Netherlands

  • Mijntje J. Pieters,

    Roles Writing – review & editing

    Affiliations Foundation Prenatal Screening Southeast region of the Netherlands, Maastricht, The Netherlands, on behalf of the Regional Centres for Prenatal Screening, The Netherlands, Department of Obstetrics and Gynecology, GROW School of Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, The Netherlands

  • Jacqueline C. I. Y. Reijerink-Verheij,

    Roles Writing – review & editing

    Affiliation Foundation Prenatal Screening Southwest region of the Netherlands, Rotterdam, on behalf of the Regional Centres for Prenatal Screening, The Netherlands

  • Robert-Jan Galjaard,

    Roles Writing – review & editing

    Affiliation Erasmus MC, Dept. of Clinical Genetics, Rotterdam, The Netherlands

  • Lidewij Henneman,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Amsterdam UMC, Vrije Universiteit Amsterdam, Dept of Clinical Genetics and Amsterdam Reproduction and Development research institute, Amsterdam, The Netherlands

  • Dutch NIPT Consortium

    Membership of the Dutch NIPT Consortium is listed in the S3 Appendix.

Abstract

This study assesses the results of a mandatory blended learning-program for counselors (e.g. midwives, sonographers, obstetricians) guiding national implementation of the Non-Invasive Prenatal Test (NIPT). We assessed counselors’ 1) knowledge about prenatal aneuploidy screening, 2) factors associated with their knowledge (e.g. counselors’ characteristics, attitudes towards NIPT), and 3) counselors’ attitudes regarding the blended learning. A cross-sectional online pretest-posttest implementation survey was sent to all 2,813 Dutch prenatal counselors. Multivariate linear regression analyses were performed to identify associations between counselors’ knowledge and e.g. their professional backgrounds, work experience and attitudes towards NIPT. At T0 and T1 1,635 and 913 counselors completed the survey, respectively. Overall results show an increased mean number of correct answered knowledge questions; 23/35 (66%) items at T0 and 28/37 (76%) items at T1. Knowledge gaps on highly specific topics remained. Work experience and secondary care work-setting were positively associated with a higher level of knowledge. Most counselors (74%) showed positive attitudes towards the blended learning program. The mandatory blended learning, along with learning by experience through implementation of NIPT, has facilitated an increase in counselors’ knowledge and was well received. New implementations in healthcare may benefit from requiring blended learning for healthcare providers, especially if tailored to professionals’ learning goals.

Introduction

Non-Invasive Prenatal Testing (NIPT) is increasingly available worldwide, as the field of prenatal screening for fetal anomalies is rapidly implementing new genetic technologies [1]. NIPT is a maternal blood test using cell-free DNA, mostly targeted at the common aneuploidies Down-, Edwards- and Patau syndrome. In most countries, NIPT is readily commercially available, although it has increasingly been offered as an aneuploidy screening test, within nationwide healthcare programs, in which mostly primary maternity care providers offer accompanying pre-test counseling [13]. Given this context, obstetric care providers have had to adapt by updating their knowledge about NIPT rapidly. Such knowledge, e.g. understanding the advantages and limitations of NIPT compared to other prenatal tests and knowing how to interpret the results, is essential to allow an adequate pregnant women’s informed choice regarding prenatal screening [47].

Given the importance of counselors’ up-to-date knowledge about NIPT, education of counselors has been an active topic for policymakers and educators. This has resulted in the development of programs aimed at improving counselors’ knowledge and communicational skills [5, 8]. In a public healthcare system, counselors’ education on NIPT typically involves a diverse palette of educational activities, so-called blended learning. Blended learning includes, for instance, face-to-face training, e-learning, assessments, and web-based information such as guidelines and Option Grid decision aids [912]. One of the challenges of educational programs is that counselors’ professional backgrounds (e.g. obstetrician, midwife, sonographers) and therefore professional knowledge differs significantly [9]. Furthermore, despite efforts to educate counselors properly, certain aspects such as the origin of cell-free fetal DNA used for NIPT and discordant/false-positive rates of NIPT seem difficult to understand [6, 9, 13]. The resulting knowledge gaps are problematic since insight into NIPT’s test characteristics is fundamental for understanding the clinical implications of the test results and the fact that NIPT is not diagnostic, diagnostic options and thereby for providing adequate counseling that supports informed decisions [4, 6, 14, 15].

Alongside these difficulties in education, providers offering counseling for prenatal aneuploidy screening report additional challenges such as biased education by commercial test providers, lack of nationwide consensus about the educational content, and trouble maintaining up-to-date knowledge about NIPT and its target anomalies [2, 5]. The challenges also result from the rapidly widening scope of NIPT, the diversity of analyses used by different laboratories, and the resulting lack of sustainable, reliable knowledge about NIPT that accompanies the evolving technical accuracy of NIPT [16, 17]. Furthermore, relatively little is known about efficient and effective educational programs accompanying implementation of NIPT, to address the educational difficulties counselors face. Finally, there is limited knowledge about the impact of counselors’ attitudes regarding NIPT on outcomes of the educational programs [18]. Such information is essential to learn more about how educational programs can be developed, implemented and improved to provide efficient and effective strategies for counselor education.

In the Netherlands, national studies (TRIDENT-1, TRIDENT-2) were launched to evaluate the organizational implementation of NIPT, test characteristics and outcomes, women’s perspectives as well as the counselors’ perspectives, and the educational requirements. In 2017, alongside the transition of NIPT from a second-tier test, only available for women with a high risk pregnancy based on the First trimester Combined Test results or medical indication, to a first-tier screening test for all pregnant women, the Dutch government set new educational requirements for healthcare professionals who provide counseling for prenatal aneuploidy screening [19, 20] (S1 Appendix). In addition to existing requirements for continuing education, counselors were obliged to participate in a blended learning program about NIPT to improve their knowledge and skills on this topic [11, 21] (Fig 1). This program addressed the first three of the four levels of Miller’s Pyramid of Professional Competence (knows, knows how, shows how and does) [22]. Our study aimed to assess the results of this mandatory blended learning program guiding national implementation of NIPT by evaluating: 1) counselors’ knowledge about prenatal aneuploidy screening, 2) factors associated with knowledge (e.g. counselor’s characteristics, attitudes towards NIPT), and 3) attitudes regarding the blended learning program. Although the blended learning program addressed the first three levels of Miller’s Pyramid of Professional Competence, here we only evaluated the effects of the blended learning program on the first level ‘knows’.

thumbnail
Fig 1. Overview of the blended learning for counselors and timing of knowledge assessment (T0 and T1) NIPT, Non-Invasive Prenatal Testing.

https://doi.org/10.1371/journal.pone.0267865.g001

Materials and methods

The current study was part of the TRIDENT-2 study to evaluate the introduction of NIPT as first-tier screening in a governmentally-funded prenatal aneuploidy screening program [9, 19, 2325].

Study design and procedures

A pre- and post-implementation survey study design was developed using an online knowledge questionnaire distributed to all registered prenatal counselors. The first assessment (T0) took place February-March 2017, before the start of the NIPT blended learning program and implementation of NIPT as first-tier aneuploidy screening test. To facilitate tailoring of the blended learning activities, we provided Regional Centers for prenatal screening (RCs) with the overall anonymous results of pre-implementation knowledge scores of the counselors. The second measurement (T1) took place approximately nine months later, after implementing the blended learning program and first-tier NIPT (November 2017-January 2018). Study participation was voluntary for completion of both questionnaires; no incentives were given.

Measures

We asked for counselors’ characteristics (age, profession, work experience, region), counseling education and number of counseling sessions a month. Furthermore, at both T0 and T1, counselors’ attitudes towards NIPT as first-tier aneuploidy screening test were measured using one, closed-ended question "What do you think about offering NIPT as a first-tier screening test?" (answer options: ’good’, ’not good’, ’neutral’).

Knowledge questionnaire

The knowledge questionnaire was developed based on questionnaires used in previous Dutch studies [6, 13, 2628] and international literature [4, 6, 29] (S2 Appendix). Development was done by a multidisciplinary team, consisting of representatives from midwifery, gynecology, psychology, clinical genetics and health sciences. After T0, the 38- item questionnaire was adjusted based on feedback from participants, and policy officers from the Centre for Population Screening at the National Institute for Public Health and the Environment (RIVM-CvB) and the RCs; unclear questions (N = 3) were excluded, and missing knowledge domains were added (N = 2). The resulting 35-item knowledge questionnaire at T0 and a 37-item knowledge questionnaire at T1 required the answers ’true’, ’false’ or ’I do not know’, and consisted of seven themes/domains: 1) Prenatal aneuploidy screening program, 2) Test characteristics of NIPT, 3) NIPT versus FCT, 4) Additional findings from NIPT and FCT, 5) In- and exclusion-criteria for NIPT and FCT, 6) Follow-up tests, and 7) Fetal structural Anomaly Screening.

Attitude regarding the blended learning education

At T1, counselors’ attitudes towards the mandatory blended learning were measured by one question ’What do you think about the mandatory blended learning education on providing the knowledge and counseling skills you have to complete to stay certified as a counselor?’ to be answered as ’good’, ’not good’, or ’other’ including space to explain the given answer.

Data collection

The questionnaire was distributed to all 2813 certified Dutch counselors [30]. Counselors received an email from their RC with a request to participate. The email contained a link to the online questionnaire and information about the research, such as the study’s purpose, voluntary participation and privacy guarantee. With this method, we aimed to prevent as much selection and information bias as possible. Two and four weeks after the questionnaire’s distribution, reminders were sent for both T0 and T1 requesting the completion of the questionnaire.

Analyses

Descriptive statistics (N, %, mean (M), or standard deviation (SD) where appropriate) were used to describe the background characteristics of participating counselors, including attitudes towards NIPT. We compared characteristics of the respondents of T0 versus T1, and to available characteristics of the Dutch counselor population to examine the representativeness and comparability of different professions (e.g. midwife, gynecologist, sonographer) and regions. Counselors’ professional background were dichotomized according to their work setting into ’primary care’ (e.g. midwives and sonographers) and ’secondary/tertiary care’ (e.g. gynecologists, medical doctors in resident and nurses).

Counselors’ pre- and post-blended learning NIPT knowledge.

Before the analyses, the answers to the knowledge questions were dichotomized into ’correct’ or ’not correct’ categories; the answer ’I do not know’ was coded as ’not correct’. Subsequently, numbers and percentages of correct answers were calculated per question, per knowledge theme and as an average of the total amount of correctly answered questions. Analyses were subsequently repeated for counselors connected to each of the RCs. If participants had answered at least 70.0% of the questions correctly, the same cutoff as used in the national e-learning and assessment developed by the RIVM-CvB (https://www.pns.nl/professionals/nipt-seo/scholing-counselors/e-learning), their knowledge was considered sufficient.

For analyzing the potential influences of the NIPT blended learning program and nine months of experience with NIPT as a first-tier test on counselors’ knowledge, frequencies of correctly answered questions were calculated per knowledge item. In addition, the sum of correctly answered items for T0 and T1 were calculated separately for the whole group and each RC.

We used multivariable, linear regression analyses to identify differences between results of the blended learning education of counselors’ knowledge at T0 and T1. Separate models were analyzed for T0 and T1, because we did not want to lean on the assumption that the same participants were included at both assessments. Backward selection was performed on the initial multivariable model for the sequential removal of variables (profession, work setting, work experience, number of counseling sessions a month, and attitude towards NIPT). In each step, the variable with the highest p-value was removed until the model contained only statistically significant variables (two-sided p < 0.05). One sample proportion tests were performed to identify significant differences between the results of T0 and T1.

Attitudes regarding the blended learning.

Attitudes regarding the mandatory blended learning education for counselors were described by applying descriptive statistics (N, %, M, SD where appropriate). All analyses were carried out using SPSS 24.0, and a significance level of p≤0.05 was maintained.

Ethical considerations

The study protocol was approved by the Medical Ethical Committee of the VU University Medical Center, Amsterdam, the Netherlands (no. 2017.165). We collected online written consent using a ‘yes’ or ‘no’ button from all participating counselors, before they could contribute in the online survey.

Results

Table 1 (Counselors’ characteristics pre- (T0) and post (T1) NIPT implementation and participation in the blended learning program) shows the background characteristics and participation of respondents. At T0, 1,635 counselors completed the knowledge questionnaire (response 1,635/2813 = 58%) and at T1, 913 counselors did so (response 913/2,813 = 32%). At both measurements, most counselors worked in primary care (83% and 80%, respectively); the majority worked as a midwife. At T1 significantly more counselors (86%) showed a positive attitude towards NIPT as a first-tier aneuploidy screening compared to T0 (75%). At T0, self-reported mean years of work experience as a counselor was M = 9.7 (SD = 5.6) years and at T1, M = 8.6 (SD = 5.6) years. At T1, the number of counseling consultations was M = 9.2 (SD = 7.6) per month.

thumbnail
Table 1. Counselors’ characteristics pre- (T0) and post (T1) NIPT implementation and participation in the blended learning program.

https://doi.org/10.1371/journal.pone.0267865.t001

Counselors’ pre- and post- blended learning NIPT knowledge

Table 2 (Counselors’ correctly answered knowledge questions at T0 (N = 1,635) and T1 (N = 913) shows counselors’ pre- and post-blended learning of NIPT as percentage of counselors who correctly answered the items in various knowledge themes. Analyses of sum scores of the respectively 35 and 37 items at T0 and T1 showed that counselors answered significantly more items correctly at T1 compared to T0; overall mean score of M = 28 (76%; SD = 3.0) correct answers versus M = 23 (66%; SD = 3.8), respectively. The overall mean scores per RC are shown in Table 3 (Overall mean scores of counselors’ knowledge represented per Prenatal Screening Region). Mean scores per RC at T0 varied between 22.5–24.0 (64%-69%) correctly answered questions, and at T1 between 28.0–29.6 (76%-80%) correctly answered questions. There were no significant difference in knowledge scores between RCs.

thumbnail
Table 2. Counselors’ correctly answered knowledge questions at T0 (N = 1,635) and T1 (N = 913).

https://doi.org/10.1371/journal.pone.0267865.t002

thumbnail
Table 3. Overall mean scores of counselors’ knowledge represented per prenatal screening region.

https://doi.org/10.1371/journal.pone.0267865.t003

Considering the scores on the separate knowledge themes, at both T0 and T1, all items of the themes NIPT versus FCT and Fetal structural Anomaly Screening (FAS) were correctly answered by more than 70% of the participating counselors. At T0 all six items of the theme In- and exclusion-criteria NIPT and FCT were answered correctly by 21% - 55% of the counselors. At T1, after the blended learning program, at least 70% of the counselors answered four of these 6 questions correctly. The remaining two items of this theme (on monochorionic pregnancies) were answered correctly by 53% and 63% of the. Half of the items on the anomalies screened for (Trisomy 13, 18 and 21) were answered correctly by less than 70% of the counselors at T1.

Multivariate linear regression analyses showed that both at T0 and T1, more years of work-experience and a secondary-care work setting were associated with significantly more correctly answered knowledge questions (T0: b = 0.068, p < 0.0001 and b = 0.003, p < 0.001; T1: b = 0.056; p = 0.002 and b = 0.002; p < 0.0001, respectively).

Attitudes regarding the blended learning program

At T1, most counselors had a positive attitude towards the mandatory blended learning program for counselors; 648 (74%) valued the blended learning as ’good’, 130 (14.9%) as ’not good’, and 97 (11.1%) counselors answered ’other’. Examples of remarks were: ’once every two years a blended learning training is too often’, ’okay, if online education is used where appropriate’, ’too much regarding counseling skills training’, and ’okay, only if major changes in (medical) developments have been made’.

Discussion

Our study aimed to assess the results of a mandatory blended learning program on prenatal screening counselors’ knowledge as part of the Dutch national implementation of NIPT. The learning program was designed to bridge knowledge gaps identified at the time NIPT was transitioned from a second-tier test, for women at an increased risk for common trisomies based on the FCT or medical history, to a first-tier test available to all pregnant women. The program was intended to be a flexible and effective framework incorporating a variety of media and methods such as e-learning and face-to-face seminars. The second voluntary knowledge assessment took place approximately nine months after NIPT transition and followed administration of the blended learning program.

Counselors, the majority of whom were midwives (80%), answered more knowledge items correctly after NIPT implementation and blended learning (76% versus 66%). Knowledge levels were positively associated with years of work experience and a secondary care work-setting. The majority (75%) had positive attitudes towards NIPT at the time of the first assessment; this rose significantly to 85% in the second survey. About three-fourth of the participating counselors had a positive attitude towards the mandatory blended learning program.

In line with previous studies in the Netherlands, counselors’ knowledge was generally considered sufficient [6]. Although counselors’ knowledge overall improved after NIPT education and several months of experience with NIPT as a first-tier test, specific areas still showed a need for improvement, despite the tailored education provided. Knowledge on the theme Trisomy 13, 18 and 21 did not improve over time; only three out of six questions were answered correctly by >70% at both T0 and T1. The incorrectly answered questions concerned development delays in Down syndrome, the fact that most children with Down syndrome are born to women younger than 36 years old, and the survival rates of a child with trisomy 13. The theme test characteristics of NIPT showed significant improvement, with 2/6 questions answered correctly by >70% at T0 increasing to 5/6 questions answered correctly at T1. The question most counselors struggled with in this theme was the false positive rate of Trisomy 13. Still, the percentage of respondents who correctly answered this question rose from 11% to 47%. The theme additional findings of NIPT and FCT also showed significant improvement in rates of correctly answered questions. The items about monochorionic pregnancies in the theme In- and exclusion-criteria NIPT and FCT were still only answered correctly by 53–63% of the counselors, at T1. This could be explained by the fact that most of the counselor work in a primary care setting and did not counsel monochorionic pregnancies, who were mostly counselled in hospitals.

The finding that not all post-implementation questions were answered correctly by >70% of the counselors may be due to the fact that some questions contained detailed knowledge of rare conditions and precise numbers which might be hard to remember, given the lack of daily use of such information. Nevertheless, optimisation of knowledge is essential since women rely on information provided by counselors to make an informed decision about prenatal aneuploidy screening, and can also influence their perception of the quality of life for children with anomalies included in NIPT. The need for providing more information on living with anomalies such as Down syndrome has been emphasised [31].

From the literature, we know that the baseline level of a counselors’ knowledge is associated with their professional background, and ongoing participation in educational programs for counselors is effective in improving knowledge levels [6, 13]. A Dutch survey study among primary care midwives showed that a positive attitude regarding prenatal screening for Down syndrome was positively associated with knowledge levels [32]. Although we observed a rise in the percentage of counselors who showed positive attitudes towards NIPT, we found no association between these attitudes and counselors’ knowledge. One explanation might be that the majority of counselors already had positive attitudes. In addition, although the uptake of NIPT differs substantially between regions (ranging from 32% to 68%) [33], according to our results, the level of counselors’ knowledge did not.

Consistent with other research [5], our respondents valued participating in educational programming regarding prenatal aneuploidy screening to improve their skills and stay up-to-date. However, also in line with other research [34], some counselors commented that the blended learning program should add something to their competencies, which might be independent of the frequency of once every two years. This outcome was also acknowledged by Dutch policymakers, resulting in a thorough evaluation of the blended learning program in 2019, and the ongoing redesign of content and program frequency in 2021 [35].

A strength of our study was the relatively high response rate. Furthermore, we recruited counselors from all over the country, resulting in a study population that was representative of the Dutch counselor population. However, we could not link the individual answers of participants in the first questionnaire to those who participated in the second one. Therefore, we do not know how much counselors did participate at both measurements. Moreover, the sole impact of the blended learning program cannot be distinguished from the nine months of ‘learning by doing’ through the implementation of first-tier NIPT. Nevertheless, our results suggest that knowledge levels in most topics were significantly improved after nine months, which by itself is promising and maybe a starting point for future research into combining a blended learning educational program with clinical practice. Finally, at T1 the counselors’ mean years of working experience was one year less compared to participants at T0, which might have led to an underestimation of knowledge levels during the second assessment, since knowledge was positively associated with the amount of work experience.

Regarding practical implications, policy makers and educators could use our study results to reflect upon the body of knowledge that counselors for prenatal aneuploidy screening should have. An interdisciplinary panel of experts could help develop such body of knowledge; through interdisciplinary dialogue, counselors can learn about the effect of their counseling on clients views and questions raised once they received a positive screening result. Furthermore, our results stress the importance of assessing knowledge levels of counselors through questionnaires that contain essential and unambiguous content, with a focus on knowledge that all counselors should have. Therefore, the development and use of diagnostic tools to accurately measure counselors’ knowledge may help to increase the awareness of personal knowledge gaps and the formulation of individual learning goals, before participating in educational training programs.

Conclusions

A mandatory blended learning program alongside the implementation of NIPT as a first-tier screening test in the Dutch prenatal screening program significantly improved counselors’ knowledge about prenatal aneuploidy screening. However, certain knowledge areas showed no or little improvement, revealing that educational tools need to be better tailored to identify and bridge the knowledge gaps for prenatal aneuploidy counselors. Individualized learning goals might optimize the effectiveness of the NIPT blended learning program. More research is needed to evaluate the effect of the blended learning program on higher levels of learning such as ’knows how’, ’shows how’ and ’does’, given the essential role counselors have to comprehensively inform pregnant women about prenatal testing.

Supporting information

S2 Appendix. Development of the blended learning program.

https://doi.org/10.1371/journal.pone.0267865.s002

(DOCX)

S3 Appendix. Members of the Dutch NIPT consortium.

https://doi.org/10.1371/journal.pone.0267865.s003

(PDF)

Acknowledgments

We gratefully acknowledge the contribution of counselors who completed the questionnaires for this study and the Regional Centres for prenatal screening for their help in recruitment. We further acknowledge Daphne de Jong and Caja Schouten for assisting in the study at the time of their Bachelor Midwifery.

References

  1. 1. Gadsbøll K., Petersen O.B., Gatinois V., Strange H., Jacobsson B., Wapner R., et al. Current use of noninvasive prenatal testing in Europe, Australia and the USA: A graphical presentation. Acta Obsted Genecol Scand. 99(6) (2020) 722–730.
  2. 2. Allyse M., A Minear M., Berson E., Sridhar S., Rote M., Hung A., Chandrasekharan S. Non-invasive prenatal testing: a review of international implementation and challenges. Int J Womens Health. 16(7) (2015) 113–126. pmid:25653560
  3. 3. Martin L., Gitsels-van der Wal J.T., Hitzert M., Henrichs J. Clients’ perspectives on the quality of counseling for prenatal anomaly screening. A comparison between 2011 and 2019. Patient Educ and Couns, (2020) 30676–30685. pmid:33388195
  4. 4. Sachs A., Blanchard L., Buchanan A., Norwitz E., Bianchi D.W. Recommended pre-test counseling points for non-invasive prenatal testing using cell-free DNA: a 2015 perspective. Prenat Diagn. 35(10) (2015) 968–71. pmid:26245889
  5. 5. Farrell R.M., Agatisa P.K., Mercer M.B., Mitchum A.G., Colderidge M.B. The use of noninvasive prenatal testing in obstetric care: educational resources, practice patterns, and barriers reported by a national sample of clinicians. Prenatal Diagnosis. 36 (2016) 499–506. pmid:26991091
  6. 6. Martin L., Gitsels J., de Boer M., Vanstone M., Henneman L. Introduction of non-invasive prenatal testing as a first-tier aneuploidy screening test: A survey among Dutch midwives about their role as counsellors. Midwifery. 56 (2018) 1–8. pmid:29024868
  7. 7. Oxenford K., Daley R., Lewis C., Hill M., Chitty L.S. Development and evaluation of training resources to prepare health professionals for counseling pregnant women about non-invasive prenatal testing for Down-syndrome: a mixed methods study. BMC Pregnancy Childbirth. 17 (2017) 132–143. pmid:28449648
  8. 8. Gregg A.R., Skotko B.G., Benkendorf J.L., Monaghan K.G., Bajaj K., Best R.G., et al. Noninvasive prenatal screening for fetal aneuploidy, 2016 update: a position statement of the American College of Medical Genetics and Genomics. Genet Med. 18(10) (2016) 1056–65. pmid:27467454
  9. 9. Oxenford K., Daley R., Lewis C., Hill M., Chitty L.S. Development and evaluation of training resources to prepare health professionals for counseling pregnant women about non-invasive prenatal testing for Down-syndrome: a mixed methods study. BMC pregnancy Childbirth, 17 (2017) 132–143. pmid:28449648
  10. 10. Beulen L., van den Berg M., Faas B.H.W., W BH, Feenstra I., Hageman M., van Vugt J.M.G., et al. The effect of a decision aid on informed decision-making in the era of non-invasive prenatal testing: a randomised controlled trial. Eur J Hum Genet. 24(10) 2016 1409–1416. pmid:27189020
  11. 11. https://pns.nl/down-edwards-patau-en-seo/professionals/scholing. [In Dutch].
  12. 12. Graham C.R., Allen S. Handbook of blended learning: Global Perspectives, local designs. San Francisco, CA: Pfeiffer Publishing. 2009.
  13. 13. Jansen C.H., de Vries J.M., Engels M., van de Kamp K., Snijders R.J., Martin L., et al. Effect of education and attitude on health professionals’ knowledge on prenatal screening. Eur J Midwifery. 4 (2020) 38. pmid:33537639
  14. 14. Hui L., Bianchi D.W. Fetal fraction and noninvasive prenatal testing: What clinicians need to know. Prenat Diag. 2019. pmid:31821597
  15. 15. Quaresima P., Visconti F., Greco E., Venturella R., Di Carlo C. Prenatal tests for chromosomal abnormalities detection (PTCAD): pregnant women’s knowledge in an Italian Population. Arch Gynecol Obstet. 2021 May;303(5):1185–1190. pmid:33111167
  16. 16. Bianchi D.W., Chiu R.W.K. Sequencing of Circulating Cell-free DNA during Pregnancy. N Engl J Med. 379 (2018) 464–473. pmid:30067923
  17. 17. Benn P., Chapman A.R. Ethical and practical challenges in providing noninvasive prenatal testing for chromosome abnormalities: an update. Current opinion in Obstetrics and Gynaecology. 28 (2016) 119–124. pmid:26938150
  18. 18. Gravel K., Légaré F., Graham I.D. Barriers and facilitators to implementing shared decision-making in clinical practice: a systematic review of health professionals’ perceptions. Implementation Science. 1 (2006) 16. pmid:16899124
  19. 19. van der Meij K.R.M., Sistermans E.A., Macville M.V.E., Stevens S.J.C., Bax C.J., Bekker M.N., et al. TRIDENT-2: National Implementation of Genome-wide Non-invasive Prenatal Testing as a First-Tier Screening Test in the Netherlands. Am J Hum Genet. 5(105;6) (2019) 1091–1101. pmid:31708118
  20. 20. Oepkes D., Page-Christiaens G.C., Bax C.J., Bekker M.N., Bilardo C. M., Boon E.M. et al. Trial by Dutch laboratories for evaluation of non-invasive prenatal testing. Part I-clinical impact. Prenat Diagn. 36(12) (2016) 1083–1090. pmid:27750376
  21. 21. Prinds C., Gitsels–van der Wal J.T., Crombag N.M.T.H., Martin L. Counselling for prenatal anomaly screening-A plea for integration of existential life questions. Patient Educ Couns 103(8) (2020). pmid:32268986
  22. 22. Albino J.E., Young S.K., Neumann L.M., Hendricson W.D. Assessing Dental Students’ Competence: Best Practice Recommendations in the Performance Assessment Literature and Investigation of Current Practices in Predoctoral Dental Education. Journal of dental education. 72(12) (2009) 1405–35.
  23. 23. van El C.G., Pieters T., Cornel M. Genetic screening and democracy: lessons from debating genetic screening criteria in the Netherlands. J Community Genet. 3(2) (2012) 79–89. pmid:22109908
  24. 24. van Schendel R.V., van El C.G., Pajkrt E., Henneman L., Cornel M.C. Implementing non-invasive prenatal testing for aneuploidy in a national healthcare system: global challenges and national solutions. BMC Health Serv Res. 17 (2017) 670. pmid:28927451
  25. 25. https://rivm.nl Uitvoeringstoets implementatie niet-invasieve prenatale test (NIPT) (openrepository.com). [In Dutch].
  26. 26. Tamminga S., van Dussen L., Verweij E.J., de Boer M.A., Cornel M.C., Henneman et L.al. What do people want to know about NIPT? Content analysis of questions emailed to national NIPT information websites. Prenat Diagn. 37(4) (2017) 412–415. pmid:28124373
  27. 27. E.J. Verweij. NIPT: Non-Invasive Prenatal Testing: Towards Implementation in the Netherlands. Leiden University (Thesis Chapter 7). 2014 view (universiteitleiden.nl).
  28. 28. Tamminga S., van Schendel R.V., Rommers W., Bilardo C.M., Pajkrt E., Dondorp W.J., et al. Changing to NIPT as a first-tier screening test and future perspectives: opinions of health professionals. Prenat Diagn. 2015;35(13):1316–23. pmid:26411372
  29. 29. Houwink E.J.F., van Luijk S.J., Henneman L., van der Vleuten C., Dinant G.J., Cornel M.C. Genetic educational needs and the role of genetics in primary care: a focus group study with multiple perspectives. BMC Fam Pract. 12 (2011) 5. pmid:21329524
  30. 30. Liefers J., Cruijsberg J., Harmsen M., Atsma F. Monitor 2016 Prenatale screening op downsyndroom en het Structureel Echoscopisch Onderzoek. 2017. [In Dutch].
  31. 31. van Schendel R.V., Kater‐Kuipers A., van Vliet‐Lachotzki E.H., Dondorp W.J., Cornel M.C., Henneman L. What Do Parents of Children with Down Syndrome Think about Non‐Invasive Prenatal Testing (NIPT)? J Gen Couns. 26(3) (2017) 522–31. pmid:27618823
  32. 32. Martin L., Gitsels-van der Wal J.T., de Boer M.A., Vanstone M., Henneman L. Introduction of non-invasive prenatal testing as a first-tier aneuploidy screening test: A survey among Dutch midwives about their role as counsellors, Midwifery. 56 (2018) 1–8. pmid:29024868
  33. 33. van der Meij K.R., de Groot‐van Mooren M., Carbo E.W., Pieters M.J., Rodenburg W., Sistermans E.A., et al. Uptake of fetal aneuploidy screening after the introduction of the non‐invasive prenatal test: a national population‐based register study. Acta Obstetricia et Gynecologica Scandinavica. 2021. pmid:33465829
  34. 34. Gould D., Drey N., EJ Berridge. Nurses’ experiences of continuing professional development. Nurse Educ Today. 27(6) (2007) 602. pmid:17109999
  35. 35. https://www.pns.nl/documenten/Counselors-aan-het-woord-over-kwaliteitseisen-prenatale-screening [In Dutch].