http://orcid.org/0000-0002-0960-5271
Figures
Abstract
As educators strive to incorporate more active learning and inquiry-driven exercises into STEM curricula, Course-based Undergraduate Research Experiences (CUREs) are becoming more common in undergraduate laboratory courses. Here we detail a CURE developed in an upper-level undergraduate genetics course at Yeshiva University, centered on the Drosophila melanogaster ortholog of the human neurodegeneration locus PLA2G6/PARK14. Drosophila PLA2G6 mutants exhibit symptoms of neurodegeneration, such as attenuated lifespan and decreased climbing ability with age, which can be replicated by neuron-specific knockdown of PLA2G6. To ask whether the neurodegeneration phenotype could be caused by loss of PLA2G6 in specific neuronal subtypes, students used GAL4-UAS to perform RNAi knockdown of PLA2G6 in subsets of neurons in the Drosophila central nervous system and measured age-dependent climbing ability. We organized our learning objectives for the CURE into three broad goals of having students think, communicate, and perform like scientists. To assess how well students achieved these goals, we developed a detailed rubric to analyze written lab reports, administered pre- and post-course surveys, and solicited written feedback. We observed striking gains related to all three learning goals, and students reported a high degree of satisfaction. We also observed significantly improved understanding of the scientific method by students in the CURE as compared to the prior year’s non-CURE genetics lab students. Thus, this CURE can serve as a template to successfully engage students in novel research, improve understanding of the scientific process, and expose students to the use of Drosophila as a model for human neurodegenerative disease.
Citation: Delventhal R, Steinhauer J (2020) A course-based undergraduate research experience examining neurodegeneration in Drosophila melanogaster teaches students to think, communicate, and perform like scientists. PLoS ONE 15(4): e0230912. https://doi.org/10.1371/journal.pone.0230912
Editor: Gregg Roman, University of Mississippi, UNITED STATES
Received: December 10, 2019; Accepted: March 11, 2020; Published: April 13, 2020
Copyright: © 2020 Delventhal, Steinhauer. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in this study are attached as Excel files in the Supporting Information.
Funding: Project funding provided by NIH (Eunice Kennedy Shriver National Institute for Child Health and Human Development) grant R15-HD080511-02 to J.S. (https://www.nichd.nih.gov/) The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Recent high profile reports have called for the reorganization of undergraduate STEM curricula around active learning strategies in order to improve undergraduate education, prepare students for the fast pace of discovery today, and increase the number of STEM trainees entering the workforce (visionandchange.org) [1,2]. One common directive emerging from these reports is increased student participation in inquiry-based learning and research experiences. Course-based Undergraduate Research Experiences (CUREs) address this goal by delivering authentic research projects within laboratory courses, thereby serving more students from a broader range of backgrounds than apprentice-based research internships [3–7]. CUREs have been shown to increase student learning as measured by pre- and post-course skills and knowledge inventories [8–11] and to have an impact on students’ conceptions of scientific research, sense of independence, and persistence in STEM majors and careers [12–15]. CUREs also confer demonstrated benefits on faculty members by advancing their research objectives, and on the broader scientific community through discovery of novel scientific results[16]. As described previously, a CURE is distinguished from other inquiry-driven exercises by inclusion of the following five elements: scientific practices, discovery, broader relevance, collaboration, and iteration [3,12].
Neurodegenerative diseases represent a growing global healthcare burden. Patients with neurodegenerative disease display a progressive loss of neurological function, leading to devastating impacts on memory and motor function, which in turn can place large socioeconomic strain on the healthcare system and caregivers. Parkinson’s disease in particular affects 1% of individuals 65 years or older and is characterized by a progressive loss of coordinated movement[17]. Although most Parkinson’s disease cases are sporadic, presumably deriving from a combination of genetic and environmental factors, instances of inherited familial parkinsonism have allowed for the identification of single gene mutations that can cause similar disease [18]. Elucidation of underlying cellular and molecular mechanisms in rare inherited forms may provide insight into the more common sporadic forms. To this end, numerous animal models have been generated with mutations in genes orthologous to human loci implicated in familial parkinsonism [19]. One of these is PARK14/PLA2G6, a disease locus for a collection of neurodegenerative disorders including early-onset dystonia-parkinsonism (collectively called PLA2G6 Associated Neurodegeneration, PLAN) [20, 21]. A null mutant in the Drosophila melanogaster PLA2G6 ortholog (also known as iPLA2-β or CG6718) generated in the Steinhauer lab exhibits a progressive loss of locomotor ability with age, consistent with neurodegeneration (J.S., manuscript in preparation). We and others were able to reproduce the locomotor defect with PLA2G6 RNAi knockdown in neurons only [22, 23].
This report details a CURE developed at Yeshiva College of Yeshiva University (YU), a private four-year liberal arts college with an all-male student body. The research objective of this CURE was to investigate whether the locomotor decline observed in PLA2G6 mutants is due to the loss of PLA2G6 in specific neuronal subsets. To test this, students performed RNAi knockdown of PLA2G6 in groups of neurons representing the major excitatory neurotransmitter pathways in the fly central nervous system (CNS), and in the insulin producing cells of the CNS [24–26]. This genetic manipulation used the classic GAL4-UAS binary gene expression system, which employs an endogenous cell-type specific promoter to direct expression of the yeast GAL4 transcription factor, which then activates expression of a UAS-controlled transgene, in this case RNAi targeting PLA2G6, in the cells of interest [27]. To monitor locomotor decline, students assessed the flies’ climbing ability using a common and straightforward behavioral assay that does not require any expensive equipment and is ideal for undergraduates (adapted from [28, 29]).
The CURE was embedded in an upper-level elective Genetics course. In prior years of the course, the laboratory used Drosophila to conduct a semester-long three factor mapping exercise in which students mapped known mutations using recombination frequencies, an inquiry-driven project that did not involve novel research. In contrast, our CURE was centered on an open-ended, authentic research question and incorporated several novel aspects relevant to the key elements of a CURE listed above, with a strong emphasis on discovery and broader human health relevance [3, 12]. Furthermore, we used the CURE elements to inform our learning goals for the course, which were for students to learn to (a) think like a scientist, (b) communicate like a scientist, and (c) perform like a scientist (i.e., perform science) [12]. We detail here our syllabus (Table 1) and our framework for assessing student performance within each of the learning goals according to specific learning objectives (Table 2). In order to investigate how the CURE compares to the prior syllabus, we developed and applied a rubric to written lab reports from both the CURE and the prior year’s mapping project and present a comparison analysis. To assess student attitudes about the CURE, we compared self-reported student outcomes pre- and post-course using the CURE survey [13, 30] (https://www.grinnell.edu/academics/resources/ctla/assessment/cure-survey) and solicited narrative feedback. All three assessment methods indicate positive effects. Overall, we found that the CURE generated large student learning gains, fostered active learning, which is lacking within our biology major curriculum, and improved student performance in written assignments when compared to the prior inquiry-driven lab course. Thus, our course can serve as a model for development of similar CUREs to engage students in novel research, incorporate discovery-based learning into biology curricula, and involve students in the use of Drosophila as a model for neurodegenerative disease.
Methods
Course structure
Experimental activities.
Students conducted a semester-long experiment to investigate a neuronal subtype-specific role of PLA2G6 in age-induced locomotor decline using Drosophila melanogaster (Table 1). Each student pair was responsible for testing PLA2G6 RNAi knockdown using one GAL4 driver from the following set: ple-GAL4 (dopaminergic), ChAT-GAL4 (cholinergic), tdc2-GAL4 (tyraminergic and octopaminergic), dilp2-GAL4 (insulin-producing neurons), VGlut-GAL4 (glutamatergic), and elav-GAL4 (pan-neuronal). Student pairs were given the opportunity to select their GAL4 drivers through a lottery system. At the beginning of the semester, students received their fly stocks and were trained to collect male and virgin female flies and distinguish balancer chromosome markers Curly and Stubble. Students established crosses between their GAL4 driver line and the UAS-RNAi-PLA2G6 line to produce F1 knockdown flies. In parallel, students established cultures of a negative control (isogenic wild-type control for PLA2G6 mutant) that climbs normally and a positive control (PLA2G6 null mutant generated previously in the Steinhauer lab) that exhibits age-induced locomotor decline by 20–30 days of age. Control cultures were reared in parallel with experimental crosses. All flies were kept at 26°C to enhance GAL4 activity. Students were instructed to pass parental cultures to fresh food at least 2x per week for 2–3 weeks to ensure a large window of F1 experimental fly eclosion. Students collected F1 males at least 2x per week to ensure that all individuals within assay fly cohorts were within a 3–4 day age range. Students were instructed to pass collected experimental flies to fresh food 2x per week to ensure health of flies during aging. Flies were tested for climbing over a 4-week period, at both young (<1 week) and various aged time points (20–35 days).
Instructional activities.
The semester began with an introductory lecture in which students were acquainted with the following concepts: history of Drosophila as a model organism, the specific genetic tools that were used in the experiment (GAL4-UAS, RNAi), PLA2G6, and neurodegenerative disease. In an iterative fashion, the instructor presented preliminary data from the Steinhauer lab and facilitated small group discussions to brainstorm follow-up experiments, which eventually led students to the neuronal subtype knockdown experiment. Students were not informed prior to the first class that they would be conducting authentic research in the lab section.
Throughout the semester, students were periodically presented with content relevant to the research through short mini-lectures during laboratory time (Table 1). Students also participated in two journal club discussions, in which they were required to read a primary research article and submit a written assignment prior to the day of the discussion (Table 1). The journal clubs were structured as “jigsaw discussions,” with question handouts to guide discussion (see Supporting Information). To conclude the semester, the students presented their work in group presentations, and each student completed an individual written report in the format of a scientific research article.
Learning goals and objectives.
Our overarching learning goals were for students to learn how to think, communicate, and perform like scientists. Each of these learning goals encompasses several learning objectives crucial to understanding and experiencing how “real” scientific research is conducted (Table 2). For example, because reviewing primary literature is an important aspect of performing science, students were required to participate in journal club discussions and use recent literature in preparation of their final written reports.
These learning goals and objectives were created to align with the core elements of a CURE as defined by Auchincloss [3] and elaborated by Brownell and Kloser [12]: use of scientific practices (thinking and communicating as a scientist, using the tools of a scientist), discovery (open-ended inquiry, illustrating the “messiness” of real data), broadly relevant or important work (to students’ lives and the scientific community), collaboration (with each other, the class, the instructor, with opportunities for discourse and accountability), and iteration (understanding the need for replication and importance of sample size, distinguishing between failed experiments and negative results). In Table 2, we detail the learning goals, their associated learning objectives, and how these align with each core CURE element.
CURE survey.
We administered the CURE survey, developed by David Lopatto [13, 30] (https://www.grinnell.edu/academics/resources/ctla/assessment/cure-survey), both pre- and post-course, using Qualtrics online survey software to anonymize responses (n = 14, see Supporting Information for raw data). The pre-course survey was administered in class before any course instruction began, and the post-course survey was administered during the last class session, after all group presentations had been completed but before final reports were due. Students provided informed consent before taking the survey, and IRB oversight was provided by Albert Einstein College of Medicine. To compare scores to the national benchmark data (https://www.grinnell.edu/sites/default/files/docs/2019-07/CUREBenchmarkStatistics2015-2108.pdf), we performed a one-sample t-test, using the national benchmark as the population mean. “Positive” science attitudes were assessed by summing scores for the following five statements (total possible score of 25), which have been found previously to factor together in a principal component factor analysis (personal communication with D. Lopatto): “Even if I forget the facts, I’ll still be able to use the thinking skills I learn in science”; “The process of writing in science is helpful for understanding scientific ideas”; “I get personal satisfaction when I solve a scientific problem by figuring it out myself”; “I can do well in science courses”; “Explaining science ideas to others has helped me understand the ideas better.” Similarly, “negative” attitudes were assessed by summing the scores for the following six statements (total possible score of 30): “I wish science instructors would just tell us what we need to know so we can learn it”; “Creativity does not play a role in science”; “Science is not connected to non-science fields such as history, literature, economics, or art”; “Science is essentially an accumulation of facts, rules, and formulas”; “There is too much emphasis in science classes on figuring things out for yourself”; “If an experiment shows that something doesn’t work, the experiment was a failure” [31, 32].
Lab report scoring.
We developed a rubric for evaluating student learning outcomes from final written lab reports, adapted from [33–37] (see Supporting Information for rubric and raw data). The rubric included subcategories that we coded according to our learning goals for students: think, communicate, and perform like scientists. We also quantified performance on understanding of biology concepts and principles of the scientific method, by coding statements throughout the written lab reports that related to either the specific experimental details of this project or general principles of experimental design. To develop a rubric with high inter-rater reliability, the two graders (R.D. and J.S.) completed two rounds of test scoring in which both authors scored six reports (three from 2017 and three from 2018), after which scores were discussed and the rubric revised. Both authors then independently applied the finalized rubric to all the written reports from both the fall 2018 semester (n = 14) and the prior year’s inquiry-based mapping laboratory (n = 24). Inter-rater reliability was measured with a Cohen’s weighted kappa value of 0.71 for the overall scores. Individual graders’ scores were averaged to derive final scores. To compare scores between the 2017 and 2018 reports, we performed a Kruskal-Wallis analysis with Dunn’s correction for multiple comparisons.
Narrative feedback.
We used an online survey to solicit anonymous, narrative feedback from students on their experiences and reactions to the course, after the conclusion of the course but before grades were distributed.
Drosophila stocks and husbandr.
ple-GAL4 (BDSC8848, RRID:BDSC_8848), VGlutOK371-GAL4 (BDSC26160, RRID:BDSC_26160), ChAT7.4-GAL4 (BDSC56500, RRID:BDSC_56500), tdc2-GAL4 (BDSC9313, RRID:BDSC_9313), dilp2-GAL4 (BDSC37516, RRID:BDSC_37516), and HMS01544 (BDSC36129, RRID:BDSC_36129) were from Bloomington Drosophila Stock Center. elav-GAL4 was a gift from J. Treisman. PLA2G6 null mutants and isogenic controls were generated in the Steinhauer lab (J.S., in preparation).
Drosophila were cultured on standard media containing 3.83% molasses, 1.58% yeast, and 3.83% corn meal, supplemented with 0.11% methyl paraben and 0.38% propionic acid as mold inhibitors.
Climbing assay.
Climbing tests were adapted from [28, 29, 38] and performed at room temperature (see Supporting Information for protocol). Groups of 6–12 male flies were tapped to the bottom of a fresh food vial and given 20 seconds to climb into a new empty vial placed on top (6 cm). Each group of flies was given five climbing trials per assay. Each fly in the group was assigned one point for every success at climbing out of the bottom vial, and the total number of points for the group was divided by the number of flies in the group to yield the climbing index. Students were instructed to assay at least four groups per condition, and results were averaged.
Results
Experimental results
Fourteen students completed the course, and they worked in self-selected pairs for the entirety of the semester. Students collected and assayed at least four groups of 6–12 flies each for each genotype (isogenic control, PLA2G6 mutant, or PLA2G6 knockdown) at young age (<10 days old) and at 22–28 days old. Because the experiment required students to attend to their flies between planned class sessions, students were given the autonomy to arrange their experiments according to their schedules. For the young flies, five out of seven student pairs tested at least two climbing cohorts for each genotype, while one pair failed to test the knockdown flies and one pair tested only one climbing cohort for each genotype. For the aged flies, six out of seven student pairs tested at least two climbing cohorts for each genotype, while one pair tested only one PLA2G6 mutant cohort. Although not explicitly instructed to do so at the beginning of the course, four out of seven student pairs elected to test flies aged beyond 30 days. Because by this time point many of the PLA2G6 mutant flies had died due to shortened lifespan [22, 23, 39], only negative control and knockdown flies could be assayed reliably. Two examples of student-generated data are shown in Fig 1. Student results for the null mutant and isogenic control were consistent with prior results from the Steinhauer lab, with climbing activity in the mutant initially normal but reduced by 20 days of age (Fig 1, J.S. in prep). In flies aged between 20–29 days, only pan-neuronal and cholinergic knockdown displayed attenuated climbing, but neither reached statistical significance (Fig 1 and not shown). In flies aged >30 days, cholinergic knockdown resulted in significantly reduced climbing activity, in contrast to knockdown in dopaminergic or tyraminergic and octopaminergic neurons (Fig 1 and not shown). Pan-neuronal knockdown flies aged >30 days appeared to show reduced climbing as well, consistent with prior data [22, 23] (J.S. in prep), but only one cohort was assayed, precluding statistical analysis for this genotype. Together, the students’ results suggest that PLA2G6 depletion in cholinergic neurons may lead to age-induced locomotor decline.
Climbing ability was tested in knockdown flies (green bars), as well as positive (PLA2G6 null mutant, gray bars) and negative control flies (isogenic wild-type, black bars) at young age (≤ 10 days) and older age (> 20 days). PLA2G6 mutant flies displayed severe climbing defects after 20 days of age. Knockdown in cholinergic neurons (A, ChAT-GAL4) but not dopaminergic neurons (B, ple-GAL4) resulted in reduced climbing in flies aged past 29 days. Averaged climbing indices are shown. Error bars are standard deviation. Lower numbers on the bars indicate the number of groups averaged; upper numbers indicate total number of flies assayed per condition. Statistical analysis by unpaired t-tests, as compared to negative controls. *p<0.01, ***p<0.0001.
CURE survey results
Students report high levels of prior experience with non-active, traditional course elements.
In the pre-course CURE survey, students were asked to rate their level of prior experience with different types of course elements or activities. These ranged from traditional approaches, such as “take tests in class” and “work individually,” to more interactive learning approaches, such as “work as a whole class” and “a lab or project where no one knows the outcome.” We found that our students rated a very high level of experience in the most traditional, inactive methods of instruction (Fig 2A): take tests in class (4.8, all scores have a maximum of 5), read a textbook (4.7), listen to lectures (4.3), and perform a cookbook lab with an expected outcome (3.7). When compared to national benchmark data gathered from students enrolled in CUREs between 2015–2018 (https://www.grinnell.edu/sites/default/files/docs/2019-07/CUREBenchmarkStatistics2015-2108.pdf), our students rated a significantly higher level of experience in taking tests and reading textbooks. This suggests that our students began the course with a more traditional academic background, with less experience in active forms of learning compared to students at other institutions. Consistent with this, in several course elements representing more active forms of learning (Fig 2B), our students reported a low level of prior experience, including in projects of student design (1.6) and critiquing the work of other students (1.8), despite having moderate to high experience with problem sets (3.5) and discussing reading materials in class (4.4). Because most of the students in this course were upper-level biology majors (S1 Fig), these results suggest that the YU biology curriculum was lacking active learning components prior to the implementation of this CURE.
Students were asked to rate level of prior experience in 25 different course elements as none (1), little (2), some (3), much (4), extensive (5). Selected traditional, non-active course elements are shown in (A) and active course elements in (B). Mean response with standard error (n = 13) is shown in light blue, with the national mean from the CURE benchmark data shown in gray. One-sample t-tests were performed to compare national mean (as population mean) to our students’ responses. *p<0.01.
Students report large benefits and gained experience in learning goals (scientific thinking, communication, and skills).
To understand whether we achieved our learning goals of having students learn to think, communicate, and perform like scientists, we examined students’ survey responses of experience gained in course elements (pre- and post-course data) and benefits gained (post-course only) that were representative of our three learning goals. We found that students reported large gains in benefits that represent thinking like scientists, such as “understanding how scientists work on real problems” (4.4) and “skill in the interpretation of results” (4.2) (Fig 3A). Related to communicating like scientists, students reported large gains in the skills of science writing and oral presentation, both as post-course benefits and in relation to pre-course experience (Fig 3B and 3D), with striking improvement compared to prior experience. Finally, students reported large gains in skills and qualities integral to performing like a scientist, such as learning laboratory techniques (4.3) and having tolerance for obstacles faced in the research process (4.2) (Fig 3C). They reported much to extensive gained experience in course elements such as reading primary literature (4.1), collecting and analyzing data (4.8 and 4.7, respectively), and participating in a project where students have input and the outcome is unknown (4.5 and 4.5) (Fig 3E), all of which are key aspects of authentic scientific research.
Students were asked to rate the amount of “benefits” gained in the post-course survey only as no/very little (1), small (2), moderate (3), large (4), and very large (5). Students were also asked to rate level of prior experience in 25 different “course elements” on the pre-course CURE survey and level of gained experience on the post-course survey as none (1), little (2), some (3), much (4), extensive (5). Selected benefits gained and course element experience/expertise relevant to learning how to “think” (A), “communicate” (B, D), and “perform” (C, E) like scientists are displayed (mean with standard error, n = 13 for course elements, n = 14 for benefits).
Students do not report major clarification of career goals, but CURE participation results in broader benefits in career preparation.
Another aspect of the CURE survey asked students about their career aspirations pre- and post-course, because a possible outcome of CURE participation is recruitment to STEM careers [4, 12, 14, 15]. Most of our students (13 out of 14) reported their intent to pursue a career in the health professions at the beginning of the course (Fig 4A), consistent with the course being an upper-level elective for biology majors and with health professions being popular career goals at this institution. At the conclusion of the course, while some students did report changing their career goals (mostly within health professions categories), half the students reported that the course had not changed their career goals (Fig 4B). This is in accord with students rating an average small to moderate gain in “clarification of career path” as compared to how the students rated other benefits of the course (Fig 4C). However, there was one student who reported a change from “other graduate school to MS in science” and another student who changed from pursuing an MD to PhD degree. Despite no strong evidence that the CURE played a large role in clarifying career goals, our students still reported large gains in self-confidence and readiness for more demanding research, which we believe will benefit them as they continue to pursue their professional and academic training (Fig 4C).
Students were asked to report career goals pre-course (A, n = 13), and any change in career goals as a result of the CURE in the post-course survey (B, n = 14). Students were asked to rate the amount of “benefits” gained in the post-course survey only as no/very little (1), small (2), moderate (3), large (4), and very large (5). Selected benefits representative of broader benefits to career goals are shown in (C, mean, standard error, n = 14). (D) Positive and negative science attitudes were assessed (see Methods) in the pre- (light blue) and post- (blue) course survey (black bars represent mean ± standard error, n = 13). National benchmark mean is shown as a single data point (gray) and one-sample t-tests using national mean as population mean show statistical significance: *p<0.01. No significant differences were found between pre- and post-course science attitudes.
Students display higher positive attitudes and lower negative attitudes towards science, both pre- and post-course.
Another possible effect of CURE participation is improved student attitudes towards science [13, 40]. In the CURE survey, students were asked to rate the degree to which they agree or disagree with various statements that reflect positive or negative attitudes towards science [13, 30]. We found that our students reported very high positive attitudes and low negative attitudes towards science (Fig 4D), especially in comparison to the national benchmark data (https://www.grinnell.edu/sites/default/files/docs/2019-07/CUREBenchmarkStatistics2015-2108.pdf). This was true pre- and post-course, suggesting that our students already had very positive existing attitudes towards science and that participation in the CURE did not markedly change them. There was a trend towards slightly lower negative attitudes post-course, but it was not significantly different from the pre-course average.
Final lab report rubric analysis results.
In addition to examining students’ self-reported gains through the CURE survey, we assessed their written lab reports for evidence of learning goal achievement. We developed a rubric (adapted from [33–37], see Supporting Information) and coded subsection elements into five different categories. The first three categories encompass components related to our three learning goals: think, communicate, and perform like a scientist. For example, each report’s introduction was expected to provide context for the experiment, describe the model system, and justify and state the research question, elements that were coded as “scientific communication,” as well as to summarize experimental goals and methods, coded as “scientific thinking.” The last two rubric categories measured overall conceptual understanding of core biological principles and principles of the scientific method (adapted from the E-EDAT [36]). To simplify grading and analysis, each rubric component was graded with 0, 1, or 2 points. Examples of graded student responses are shown in Table 3. Overall, we found that students in the CURE displayed very high levels of achievement in the three learning goals (medians 83%, 90%, and 91% for “communicate,” “perform,” and “think” categories, respectively), with the highest scores in the “think” subsection (Fig 5A). Scores in the scientific method assessment were even higher, with a median of 96%. As a point of comparison, we also applied the rubric to 24 lab reports from the prior year, when students in the same course conducted a semester-long inquiry-based mapping project using Drosophila but were not engaged in authentic, open-ended research (Fig 5A, “2017 inquiry-based”). In both the 2017 and 2018 classes, the majority of students were upper-level biology majors on the pre-health track, suggesting that the two student populations were demographically similar (S1 Fig). Compared to the CURE, lab reports from the prior year scored significantly lower, with class medians of 52%, 55%, and 77% in the “communicate,” “perform,” and “think” categories, respectively (Fig 5A). Similarly, in the scientific method category, the 2017 class median was 77%, significantly lower than the CURE class median of 96%. Among the scientific method sub-elements (Fig 5B), students in the CURE showed significantly greater ability than students in the prior year in describing the biological rationale for their experiments (rubric element 10b), identifying independent and dependent variables (10c), describing how the dependent variable was measured (10d), identifying experimental and control groups (10f), and proposing future experiments (10j). Interestingly, both groups of students scored equally well in stating the experimental hypothesis (10a), understanding that other variables must be held constant (10e), understanding the importance of sample size (10g), and moderating their conclusions to account for multiple explanations or sources of error (10h). Finally, in contrast to the other rubric categories, scores from the 2018 CURE were significantly lower than those from the 2017 reports in the biological principles section (67% class median for 2018 compared to 83% class median for 2017, Fig 5A). This likely reflects the fact that the assessed biological concepts were different between the two years by necessity; the 2017 experiment centered on the concepts of genetic loci and recombination mapping, relatively simple concepts compared to the variety and complexity of concepts covered in the CURE (see Discussion).
(A) Written lab reports from the 2018 CURE lab (blue, n = 14) and prior year non-CURE lab (“2017 inquiry-based,” gray, n = 24) were scored according to our rubric (see Methods) in five different areas: communicate, think, and perform like a scientist learning goals, conceptual understanding of biological principles relevant to the lab experiments, and conceptual understanding of scientific methods principles. Each score is reported as a percentage of the total possible points in that category. Bars are medians and interquartile ranges, statistical analysis by Kruskal-Wallis test with Dunn’s correction for multiple comparisons. ****p<0.0001, ***p<0.001, *p<0.05. (B) Lab reports from the 2018 CURE scored higher in rubric elements relevant to the scientific method (section 10). Blue bars represent percentage of 2018 lab reports that earned 0, 0.5, 1, 1.5, or 2 points on each rubric element (scores of 0.5 and 1.5 resulted from averaging the two independent graders’ scores). Gray bars represent 2017 lab reports.
Narrative feedback.
We solicited anonymous written feedback from students at the conclusion of the course, and a few major themes emerged (Table 4). Many comments indicated preference for the CURE over traditional labs and implored the authors to offer more lab courses designed as CUREs, and no students said they preferred the traditional style of lab class. Many described feeling that their activities in traditional labs they had taken in the past were meaningless and inconsequential. In contrast, by participating in authentic, open-ended research through this CURE, they felt that the work was meaningful, and as a result, they were more engaged and motivated to learn. Many students said they valued being treated as “active participants,” rather than “passive students” simply there for the grade, and they appreciated the level of responsibility they were given to carry out the experiments independently.
Discussion
We conducted a genetics laboratory CURE to investigate neurodegeneration in Drosophila using climbing assays in conjunction with common, readily available genetic tools, including GAL4-UAS and RNAi. Experimental results may point to a prominent contribution of cholinergic neurons to the etiology of PLAN, which is somewhat unexpected given that motor decline in Parkinson’s disease has been attributed primarily to the loss of dopaminergic neurons [41]. Indeed, recent experimental PLAN models have focused on dopaminergic neuron loss in mouse, zebrafish, and Drosophila [42–44]. Still, human PLAN patients display degeneration in multiple brain areas, and a role for cholinergic neurons in Parkinson’s is beginning to be investigated [20, 41]. To understand the mechanism of motor decline in dystonia-parkinsonism and other PLAN diseases, future exploration of multiple neuronal subtypes is warranted, with possible applicability to other forms of parkinsonism as well. This CURE enriched the YU biology curriculum, in which traditional pedagogical approaches were over-represented and active inquiry-based approaches were lacking, and it involved students in a project with especially strong relevance to human disease and biomedical research. Students who took the CURE demonstrated large learning gains in thinking, communicating, and performing like scientists, as evidenced by both self-reporting in pre- and post-course CURE surveys and rubric-based analysis of written lab reports.
Written lab reports demonstrate higher levels of scientific thinking, communication, and performance in the CURE than in the previous inquiry-based lab course
We developed a rubric, coded according to our learning goals of thinking, communicating, and performing like a scientist, to analyze students’ final lab reports (Supporting Information). Two additional sections of the rubric assessed overall understanding of biological principles and the scientific method, the latter adapted from the E-EDAT [36]. Although several elements within the scientific method section were redundant with elements in other sections, we included it as a separate entity in order to assess students’ general understanding of the key principles of experimental design, apart from the course particulars (see below, [36]). This rubric was developed ex post facto for analysis of our students’ learning gains. However, it could be adapted easily for use as a summative assessment instrument in future iterations of this course. Indeed, we found it permitted precise and detailed evaluation of students’ understanding, and its high inter-rater reliability (Cohen’s weighted kappa = 0.71) demonstrates its utility in reducing grader bias.
Although the CURE lab reports demonstrated high achievement in most rubric categories, our analysis identified gaps in understanding the relevant biological principles (class median 67% in this category), which included the contribution of neuronal subtypes to neurodegenerative disease, the role of PLA2G6 in neurodegeneration, the use of Drosophila as a model organism, the GAL4-UAS system (which incorporates transcriptional regulation and transgenic organisms), and RNA interference. We consider it a strength of the CURE that students were challenged to think about a bona fide modern experiment in context, but care must be taken to guide students’ understanding to full fruition during class discussions. Formative assessments throughout the semester would furnish useful feedback to instructors and students before final lab reports are submitted.
Compared to the prior year’s lab reports, which centered on an inquiry-based mapping procedure, the CURE lab reports demonstrated greater achievement in the three rubric categories of communicating, thinking, and performing like scientists, with median class scores above 83% in each category and cross-year differences in the communicate and perform categories reaching statistical significance. This comparison analysis suggests that the emphasis on bona fide experimentation and reporting in the CURE imparts strong benefits to students beyond those provided by other inquiry-driven exercises. However, because we cannot currently parse this key difference from other differences between the two years, including different experimental structures, different underlying principles, different students, different instructors (J.S. in year 1, R.D. in year 2), and a lack of primary literature incorporation in 2017, conclusions from our cross-year comparison may be limited. Notably, however, CURE students also demonstrated strikingly higher scores in the scientific method section of our rubric, with a class median of 96%, compared to 77% in 2017. This suggests that the CURE improved students’ understanding of the scientific process and instilled key scientific skills that extend beyond the course particulars, including in describing the biological rationale for their experiments, in identifying independent and dependent variables as well as experimental and control groups, and in designing future experiments to distinguish between multiple explanations (Fig 5). Thus, we believe it is reasonable to conclude that the CURE enhanced student learning above an inquiry-based project, particularly in areas related to the scientific process.
CURE survey results and student narrative feedback suggest strong engagement with the project and direct learning benefits
We administered the widely used CURE survey developed by D. Lopatto to measure students’ self-reported learning gains. Consistent with the lab report scoring, students reported large gains post-course in key aspects related to our learning goals of thinking, communicating and performing like a scientist (Fig 3). One possibility to consider is that our students were predisposed to have particularly positive outcomes in the CURE due to their higher positive and lower negative pre-course science attitudes than the national average (Fig 4). Although we cannot control for this sample bias, our student sample was at least free from volunteer bias because this was the first formal CURE at YU and the format was not advertised, thereby eliminating student self-selection for the CURE course format [45]. According to student narrative responses (see Table 4), being an active participant in authentic novel research with broader relevance was very personally meaningful and motivating for the students. Because students were responsible for generating a unique and novel dataset with the potential to contribute to a medical problem that carries acute emotional impact, feelings of ownership and accountability were high. This, in combination with the instructional emphasis on the scientific process, could explain the dramatic increase in learning gains [46]. The student narrative feedback provides a qualitative context for the positive results obtained from the CURE survey, which directly compares pre- and post-course responses, and the rubric-based lab report scoring, which does not rely on student self-reporting. All three forms of assessment taken together strongly support the conclusion that students benefited directly from the CURE.
CUREs and other inquiry-based exercises have been recommended as a mechanism to recruit and retain STEM students [2, 4]. Consistent with this proposal, our students reported large gains in readiness for more demanding research post-course (Fig 4C). However, we could not draw strong conclusions about the CURE’s effectiveness in STEM recruitment and/or retention because our student population consisted of mostly pre-health upper-level biology majors [15]. Our students were already committed to STEM careers, and thus 50% of the class reported no change in career goals following the course, and “clarification of a career path” showed only a very modest gain in the post-course benefits (Fig 4). This is consistent with mounting evidence that research experiences within the first two undergraduate years are more effective at promoting persistence in STEM fields than in later years [14, 15]. Still, we believe that our students’ careers will benefit in other ways from participation in the CURE. In particular, the gains related to communicating like a scientist and interfacing with the primary literature will be critical as they pursue careers in medical fields that are rapidly advancing. As shown in Fig 4C, students also reported large gains in self-confidence, which can be a positive attribute in any career path. Future studies will need to follow larger cohorts of CURE students, including some from introductory level courses, as they progress through their undergraduate curriculum and matriculate into graduate programs to address the question of STEM recruitment and retention [4].
Implementing the CURE
Understanding and combatting neurodegeneration is currently of paramount importance to medicine and human health, and animal models have proven to be extremely valuable in elucidating underlying genetic and molecular mechanisms [19, 47]. The climbing assay is a standard test of neurodegeneration in the Drosophila model system and can be performed by novice students at minimal cost [28, 29]. Incorporating this experiment into a CURE provides students with the opportunity to participate in novel open-ended research with high impact potential and strong emotional appeal. We also designed our course to incorporate the key CURE elements of collaboration and iteration, with each student pair responsible for knocking down PLA2G6 in only one subset of neurons, such that student-generated results were best understood in the context of the entire class dataset.
Students were required to attend to their flies on their own time and were given latitude to plan their experiments. This appeared to stimulate strong student engagement and provided the opportunity to perform like “real” scientists, but potentially at the expense of data consistency. While students in this CURE were able to generate interesting preliminary data that will guide future experiments, in order to generate higher fidelity data, stricter experimental guidelines may be necessary. In the narrative feedback responses, a few comments highlighted the time commitment and the high potential for negative results as negative attributes of the CURE (see Table 3). We recommend using class discussions to frame these aspects as part of the scientific process, while acknowledging the possibility that some students will discover that science is not their calling.
The design of this CURE experiment can be applied to other genes, environmental perturbations, or genetic or pharmacological screens, and it can be modified easily to accommodate larger class sizes (e.g., by using more GAL4 lines, having multiple student pairs test overlapping genotypes, or having different student pairs test flies of different sexes or ages) and introductory students (e.g., by creating strict guidelines for experimentation). We have found that for those students inclined toward scientific inquiry, not only is the CURE an enriching and rewarding experience, but it also serves as a recruitment tool for apprentice-based research internships, with the added advantage that students are already trained in the techniques. Thus, this CURE, based on a simple physiological assay in Drosophila, has the potential to contribute novel findings to the field of neurodegeneration in a format that confers large student learning gains and tangential benefits to both students and faculty instructors.
Supporting information
S1 Fig. Student demographics in 2017 and 2018 are similar.
(A) A majority of students in both 2017 and 2018 classes were biology majors (blue). (B) A majority of students in both 2017 and 2018 classes were upper classmen (third year, orange, and fourth year, yellow).
https://doi.org/10.1371/journal.pone.0230912.s001
(EPS)
S2 File. Guided reading worksheet.
Adapted from Sarah Petersen, Kenyon College, personal communication to R.D.
https://doi.org/10.1371/journal.pone.0230912.s003
(DOCX)
S3 File. Figure/table analysis worksheet.
Adapted from [48].
https://doi.org/10.1371/journal.pone.0230912.s004
(DOCX)
S5 File. Journal club discussion questions.
In reference to [49].
https://doi.org/10.1371/journal.pone.0230912.s006
(DOCX)
S6 File. Student guidelines for group presentations.
https://doi.org/10.1371/journal.pone.0230912.s007
(DOCX)
S7 File. Instructor grading rubric for group presentations.
https://doi.org/10.1371/journal.pone.0230912.s008
(DOCX)
S8 File. Student peer feedback form for group presentations.
https://doi.org/10.1371/journal.pone.0230912.s009
(DOCX)
S9 File. Student guidelines for lab reports.
Adapted from [33].
https://doi.org/10.1371/journal.pone.0230912.s010
(DOCX)
S10 File. Instructor grading rubric for lab reports.
https://doi.org/10.1371/journal.pone.0230912.s011
(DOCX)
Acknowledgments
We thank Jennifer Kennell, Elizabeth Genné-Bacon, Erika Crispo, and David Lopatto for critical comments on the manuscript; the Albert Einstein College of Medicine IRB for oversight; Liam Eliach and Raymond Reynoso for assistance in the lab; and Mimi Shirasu-Hiza for mentorship. Stocks obtained from the Bloomington Drosophila Stock Center (NIH P40OD018537) were used in this study.
References
- 1.
Council NR. BIO2010: Transforming Undergraduate Education for Future Research Biologists. Washington, DC: The National Academies Press; 2003. 208 p.
- 2. Gates SJ Jr, Mirkin C. Engage to excel. Science. 2012;335(6076):1545. pmid:22461573
- 3. Auchincloss LC, Laursen SL, Branchaw JL, Eagan K, Graham M, Hanauer DI, et al. Assessment of course-based undergraduate research experiences: a meeting report. CBE Life Sci Educ. 2014;13(1):29–40. pmid:24591501
- 4. Corwin LA, Graham MJ, Dolan EL. Modeling course-based undergraduate research experiences: an agenda for future research and evaluation. CBE Life Sci Educ. 2015;14(1):es1. pmid:25687826
- 5. Shaffer CD, Alvarez CJ, Bednarski AE, Dunbar D, Goodman AL, Reinke C, et al. A course-based research experience: how benefits change with increased investment in instructional time. CBE Life Sci Educ. 2014;13(1):111–30. pmid:24591510
- 6. Wei CA, Woodin T. Undergraduate research experiences in biology: alternatives to the apprenticeship model. CBE Life Sci Educ. 2011;10(2):123–31. pmid:21633057
- 7. Shapiro C, Moberg-Parker J, Toma S, Ayon C, Zimmerman H, Roth-Johnson EA, et al. Comparing the Impact of Course-Based and Apprentice-Based Research Experiences in a Life Science Laboratory Curriculum. J Microbiol Biol Educ. 2015;16(2):186–97. pmid:26751568
- 8. Laungani R, Tanner C, Brooks TD, Clement B, Clouse M, Doyle E, et al. Finding Some Good in an Invasive Species: Introduction and Assessment of a Novel CURE to Improve Experimental Design in Undergraduate Biology Classrooms. J Microbiol Biol Educ. 2018;19(2).
- 9. Peteroy-Kelly MA, Marcello MR, Crispo E, Buraei Z, Strahs D, Isaacson M, et al. Participation in a Year-Long CURE Embedded into Major Core Genetics and Cellular and Molecular Biology Laboratory Courses Results in Gains in Foundational Biological Concepts and Experimental Design Skills by Novice Undergraduate Researchers. J Microbiol Biol Educ. 2017;18(1).
- 10. Zwick M. The Design, Implementation, and Assessment of an Undergraduate Neurobiology Course using a Project-Based Approach. J Undergrad Neurosci Educ. 2018;16(2):A131–A42. pmid:30057495
- 11. Genne-Bacon EA, Bascom-Slack CA. The PARE Project: A Short Course-Based Research Project for National Surveillance of Antibiotic-Resistant Microbes in Environmental Samples. J Microbiol Biol Educ. 2018;19(3).
- 12. Brownell SE, Kloser MJ. Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology. Studies in Higher Education. 2015;40(3):525–44.
- 13. Lopatto D. Undergraduate research experiences support science career decisions and active learning. CBE Life Sci Educ. 2007;6(4):297–306. pmid:18056301
- 14. Graham MJ, Frederick J, Byars-Winston A, Hunter AB, Handelsman J. Science education. Increasing persistence of college students in STEM. Science. 2013;341(6153):1455–6. pmid:24072909
- 15. Harrison M, Dunbar D, Ratmansky L, Boyd K, Lopatto D. Classroom-based science research at the introductory level: changes in career choices and attitude. CBE Life Sci Educ. 2011;10(3):279–86. pmid:21885824
- 16. Shortlidge EE, Bangera G, Brownell SE. Each to Their Own CURE: Faculty Who Teach Course-Based Undergraduate Research Experiences Report Why You Too Should Teach a CURE. J Microbiol Biol Educ. 2017;18(2).
- 17. Trinh J, Farrer M. Advances in the genetics of Parkinson disease. Nat Rev Neurol. 2013;9(8):445–54. pmid:23857047
- 18. Deng H, Wang P, Jankovic J. The genetics of Parkinson disease. Ageing Res Rev. 2018;42:72–85. pmid:29288112
- 19. Hewitt VL, Whitworth AJ. Mechanisms of Parkinson’s Disease: Lessons from Drosophila. Curr Top Dev Biol. 2017;121:173–200. pmid:28057299
- 20.
Gregory A, Kurian MA, Maher ER, Hogarth P, Hayflick SJ. PLA2G6-Associated Neurodegeneration. In: Adam MP, Ardinger HH, Pagon RA, Wallace SE, Bean LJH, Stephens K, et al., editors. GeneReviews((R)). Seattle (WA)1993.
- 21. Morgan NV, Westaway SK, Morton JE, Gregory A, Gissen P, Sonek S, et al. PLA2G6, encoding a phospholipase A2, is mutated in neurodegenerative disorders with high brain iron. Nat Genet. 2006;38(7):752–4. pmid:16783378
- 22. Iliadi KG, Gluscencova OB, Iliadi N, Boulianne GL. Mutations in the Drosophila homolog of human PLA2G6 give rise to age-dependent loss of psychomotor activity and neurodegeneration. Sci Rep. 2018;8(1):2939. pmid:29440694
- 23. Kinghorn KJ, Castillo-Quan JI, Bartolome F, Angelova PR, Li L, Pope S, et al. Loss of PLA2G6 leads to elevated mitochondrial lipid peroxidation and mitochondrial dysfunction. Brain. 2015;138(Pt 7):1801–16. pmid:26001724
- 24. Martin CA, Krantz DE. Drosophila melanogaster as a genetic model system to study neurotransmitter transporters. Neurochem Int. 2014;73:71–88. pmid:24704795
- 25. Ramanadham S, Song H, Hsu FF, Zhang S, Crankshaw M, Grant GA, et al. Pancreatic islets and insulinoma cells express a novel isoform of group VIA phospholipase A2 (iPLA2 beta) that participates in glucose-stimulated insulin secretion and is not produced by alternate splicing of the iPLA2 beta transcript. Biochemistry. 2003;42(47):13929–40. pmid:14636061
- 26. Broughton S, Partridge L. Insulin/IGF-like signalling, the central nervous system and aging. Biochem J. 2009;418(1):1–12. pmid:19159343
- 27. Caygill EE, Brand AH. The GAL4 System: A Versatile System for the Manipulation and Analysis of Gene Expression. Methods Mol Biol. 2016;1478:33–52. pmid:27730574
- 28. Barone MC, Bohmann D. Assessing neurodegenerative phenotypes in Drosophila dopaminergic neurons by climbing assays and whole brain immunostaining. J Vis Exp. 2013(74):e50339. pmid:23644755
- 29. Neckameyer WS, Bhatt P. Protocols to Study Behavior in Drosophila. Methods Mol Biol. 2016;1478:303–20. pmid:27730591
- 30. Lopatto D. Survey of Undergraduate Research Experiences (SURE): first findings. Cell Biol Educ. 2004;3(4):270–7. pmid:15592600
- 31. Perera V, Mead C, Buxner S, Lopatto D, Horodyskyj L, Semken S, et al. Students in Fully Online Programs Report More Positive Attitudes toward Science Than Students in Traditional, In-Person Programs. CBE Life Sci Educ. 2017;16(4).
- 32. Hoskins SG, Lopatto D, Stevens LM. The C.R.E.A.T.E. approach to primary literature shifts undergraduates’ self-assessed ability to read and analyze journal articles, attitudes about science, and epistemological beliefs. CBE Life Sci Educ. 2011;10(4):368–78. pmid:22135371
- 33. Brigati JR, Swann JM. Facilitating improvements in laboratory report writing skills with less grading: a laboratory report peer-review process. J Microbiol Biol Educ. 2015;16(1):61–8. pmid:25949758
- 34. Killpack TL, Fulmer SM. Development of a Tool to Assess Interrelated Experimental Design in Introductory Biology. J Microbiol Biol Educ. 2018;19(3).
- 35. Timmerman BEC, Strickland DC, Johnson RL, Payne JR. Development of a ‘universal’ rubric for assessing undergraduates’ scientific reasoning skills using scientific writing. Assessment & Evaluation in Higher Education. 2011;36(5):509–47.
- 36. Brownell SE, Wenderoth MP, Theobald R, Okoroafor N, Koval M, Freeman S, et al. How Students Think about Experimental Design: Novel Conceptions Revealed by in-Class Activities. BioScience. 2013;64(2):125–37.
- 37. Sirum K HJ. The Experimental Design Ability Test (EDAT). Bioscene. 2011;37(1):8–16.
- 38. Steinhauer J, Gijon MA, Riekhof WR, Voelker DR, Murphy RC, Treisman JE. Drosophila lysophospholipid acyltransferases are specifically required for germ cell development. Mol Biol Cell. 2009;20(24):5224–35. pmid:19864461
- 39. Lin G, Lee PT, Chen K, Mao D, Tan KL, Zuo Z, et al. Phospholipase PLA2G6, a Parkinsonism-Associated Gene, Affects Vps26 and Vps35, Retromer Function, and Ceramide Levels, Similar to alpha-Synuclein Gain. Cell Metab. 2018;28(4):605–18 e6. pmid:29909971
- 40. Ballen CJ, Blum JE, Brownell S, Hebert S, Hewlett J, Klein JR, et al. A Call to Develop Course-Based Undergraduate Research Experiences (CUREs) for Nonmajors Courses. CBE Life Sci Educ. 2017;16(2).
- 41. Rizzi G, Tan KR. Dopamine and Acetylcholine, a Circuit Point of View in Parkinson’s Disease. Front Neural Circuits. 2017;11:110. pmid:29311846
- 42. Chiu CC, Lu CS, Weng YH, Chen YL, Huang YZ, Chen RS, et al. PARK14 (D331Y) PLA2G6 Causes Early-Onset Degeneration of Substantia Nigra Dopaminergic Neurons by Inducing Mitochondrial Dysfunction, ER Stress, Mitophagy Impairment and Transcriptional Dysregulation in a Knockin Mouse Model. Mol Neurobiol. 2019;56(6):3835–53. pmid:30088174
- 43. Sanchez E, Azcona LJ, Paisan-Ruiz C. Pla2g6 Deficiency in Zebrafish Leads to Dopaminergic Cell Death, Axonal Degeneration, Increased beta-Synuclein Expression, and Defects in Brain Functions and Pathways. Mol Neurobiol. 2018;55(8):6734–54. pmid:29344929
- 44. Mori A, Hatano T, Inoshita T, Shiba-Fukushima K, Koinuma T, Meng H, et al. Parkinson’s disease-associated iPLA2-VIA/PLA2G6 regulates neuronal functions and alpha-synuclein stability through membrane remodeling. Proc Natl Acad Sci U S A. 2019;116(41):20689–99. pmid:31548400
- 45. Brownell SE, Kloser MJ, Fukami T, Shavelson RJ. Context matters: volunteer bias, small sample size, and the value of comparison groups in the assessment of research-based undergraduate introductory biology lab courses. J Microbiol Biol Educ. 2013;14(2):176–82. pmid:24358380
- 46. Chan PE, Graham-Day KJ, Ressa VA, Peters MT, Konrad M. Beyond Involvement:Promoting Student Ownership of Learning in Classrooms. Intervention in School and Clinic. 2014;50(2):105–13.
- 47. Katsnelson A, De Strooper B, Zoghbi HY. Neurodegeneration: From cellular concepts to clinical applications. Sci Transl Med. 2016;8(364):364ps18. pmid:27831899
- 48. Hoskins SG, Stevens LM, Nehm RH. Selective use of the primary literature transforms the classroom into a virtual laboratory. Genetics. 2007;176(3):1381–9. pmid:17483426
- 49. Brand AH, Perrimon N. Targeted gene expression as a means of altering cell fates and generating dominant phenotypes. Development. 1993;118(2):401–15. pmid:8223268