Outer membrane vesicles (OMV) contain immunogenic proteins and contribute to in vivo survival and virulence of bacterial pathogens. The first OMV vaccines successfully stopped Neisseria meningitidis serogroup B outbreaks but required detergent-extraction for endotoxin removal. Current vaccines use attenuated endotoxin, to preserve immunological properties and allow a detergent-free process. The preferred process is based on spontaneously released OMV (sOMV), which are most similar to in vivo vesicles and easier to purify. The release mechanism however is poorly understood resulting in low yield. This study with N. meningitidis demonstrates that an external stimulus, cysteine depletion, can trigger growth arrest and sOMV release in sufficient quantities for vaccine production (±1500 human doses per liter cultivation). Transcriptome analysis suggests that cysteine depletion impairs iron-sulfur protein assembly and causes oxidative stress. Involvement of oxidative stress is confirmed by showing that addition of reactive oxygen species during cysteine-rich growth also triggers vesiculation. The sOMV in this study are similar to vesicles from natural infection, therefore cysteine-dependent vesiculation is likely to be relevant for the in vivo pathogenesis of N. meningitidis.
Citation: van de Waterbeemd B, Zomer G, van den IJssel J, van Keulen L, Eppink MH, van der Ley P, et al. (2013) Cysteine Depletion Causes Oxidative Stress and Triggers Outer Membrane Vesicle Release by Neisseria meningitidis; Implications for Vaccine Development. PLoS ONE 8(1): e54314. https://doi.org/10.1371/journal.pone.0054314
Editor: Lisa A. Morici, Tulane University School of Medicine, United States of America
Received: September 12, 2012; Accepted: December 11, 2012; Published: January 23, 2013
Copyright: © 2013 van de Waterbeemd et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was funded by the Dutch Ministry of Health, Welfare and Sport (www.minvws.nl). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The release of outer membrane vesicles (OMV) is observed among many bacterial species including gram-negative pathogens like Escherichia coli, Vibrio cholerae, Salmonella typhimurium or Neisseria meningitidis . Pathogens produce OMV for in vivo survival, virulence or interactions with the host immune system , , . The vesicles are spherical particles with a diameter of 50–200 nm, containing a phospholipid bilayer with outer membrane proteins, lipopolysaccharide (LPS or endotoxin) and a lumen with periplasmic constituents , . N. meningitidis serogroup B epidemics in Norway, Cuba and New-Zealand were successfully controlled with outer membrane vesicle vaccines, which was a milestone for the application of OMV in vaccinology , , , . These vaccines however required extraction with a detergent (deoxycholate), to decrease the amount of toxic LPS. The detergent-extraction was effective but resulted in partially intact and aggregated vesicles with an altered composition , , . Discovery of the lpxL1 mutation successfully attenuated the LPS of N. meningitidis and allowed the use of detergent-free OMV . This provided vaccine concepts with equally low toxicity but improved immunological and biochemical properties , , , . Detergent-free OMV are more similar to in vivo produced vesicles  and are now used for the development of several next-generation vaccines against serogroup B meningococcal disease , , , , .
There are two types of detergent-free OMV. The first type, sOMV (spontaneously released OMV), is as similar to in vivo vesicles as possible with a production system for human vaccines . The sOMV are released by the bacterium during in vitro growth, without any treatments to enhance vesiculation , . The second type, eOMV (extracted OMV, also referred to as native OMV) , , ), uses detergent-free extraction with ethylene-diamine-tetraacetic acid (EDTA) to chelate calcium and magnesium ions. This destabilizes the outer membrane which enhances eOMV release and preserves the desired biochemical and immunological properties, even though eOMV are not fully identical to sOMV , , , , . The properties do change significantly when detergents are added to the extraction buffer. The purification of eOMV is less straightforward than sOMV purification due to more complicated handling (i.e. the extraction step; Figure S1). New approaches that release sOMV in sufficient quantities to compensate the EDTA extraction step are therefore relevant for vaccine development.
Even though the existence of sOMV is known for decades, the mechanism that triggers their release is not fully understood , . A model was proposed for S. typhimurium in which the density of associations between inner membrane, outer membrane and peptidoglycan layer regulates vesicle release . This model was in agreement with observations that disruption of transmembrane anchor genes increased vesiculation (i.e. tol, pal and ompA in E. coli or rmpM in N. meningitidis) , . Not only physical changes to the outer membrane but also external stimuli can trigger sOMV release. For E. coli these stimuli include heat shock, activitation of the envelope stress response pathway or lysine depletion , , , . Such external triggers have not been identified for N. meningitidis but recent work indicated that vesicle yield increased significantly during stationary growth .
This study demonstrates that a novel external stimulus, depletion of cysteine, can trigger the onset of stationary growth and sOMV release by N. meningitidis. It is substantiated that cysteine depletion causes oxidative stress as the intracellular signal for increased vesiculation. The results also demonstrate that this approach is applicable for vaccine production.
Cysteine is the Growth-limiting Medium Component
Previous work showed that vesicle release by N. meningitidis increased during the stationary growth phase . To identify the growth-limiting medium component of these experimental conditions, nutrient consumption was monitored. Arginine and cysteine were depleted upon onset of stationary growth, while the growth medium still contained sufficient amounts of all other components (data not shown). Therefore, concentrations of arginine and cysteine were lowered systematically to identify the growth-limiting component (Figure 1). Control medium with normal amounts of cysteine and arginine produced regular growth curves in shake flasks (exponential growth; dry biomass yield 3.9±0.1 gdw/L). Medium with normal cysteine but half the normal amount of arginine gave identical growth (exponential; 4.2±0.3 gdw/L), indicating that less arginine did not have an effect on growth. Media with half the amount of cysteine however produced half the amount of biomass, regardless the amount of arginine (1.9±0.1 gdw/L and 2.1±0.1 gdw/L for normal and low arginine, respectively). Nutrient analysis confirmed that cysteine was indeed depleted upon onset of stationary growth for all 4 media, while arginine depletion ocurred at a different time point (Figure S2). These results indicate that cysteine, not arginine, is the growth-limiting component of the medium.
Previous work demonstrated that vesicle release by N. meningitidis increased during the stationary growth phase . Nutrient analysis of the chemically defined medium indicated that only arginine and cysteine were depleted during early stationary growth. Therefore, concentrations of both components were systematically lowered to identify the growth-limiting nutrient. Black lines and black intersected lines represent growth curves on media with normal and low arginine concentration, respectively. Normal and low cysteine concentrations are marked with circles and triangles. Cultivation time t = 0 represents the expected onset of stationary growth on reference medium with normal amounts of cysteine and arginine. The results indicate that cysteine, not arginine is the growth-limiting component. See Figure S2 for corresponding nutrient data.
Transcriptome Analysis Identified 149 Cysteine Regulated Genes
Transcriptome analysis was performed with DNA microarrays to identify genes that are regulated after cysteine depletion. Growth and cysteine availability of triplicate cultivations on normal growth medium were monitored. Transcriptome analysis was performed on samples at −2.5, −1.4 and −0.4 hours (before cysteine depletion) and at +1.4 and +3.5 hours (after cysteine depletion). Principal component analysis on the full transcriptome confirmed high reproducibility of replicates (Figure S3A). The experimental treatment (cysteine depletion) accounted for 70% of total gene expression variation and resulted in 2 distinct groups on the first principal component axis (PC1; corresponding to ‘before’ and ‘after’ cysteine depletion). PC2 explained 7% of all variation and the other principal components <5%, indicating that additional effects had only a minor impact on overall gene expression. Subsequent statistical analysis selected 149 significantly regulated genes (Fold Ratio >2.0 and False Discovery Rate <0.10). Upon cysteine depletion, 90 genes were upregulated and 48 were downregulated. A variable expression pattern was observed for 11 genes (Figure S3B).
The Gene Expression Profile of Cysteine Depletion Resembles (Oxidative) Stress and Virulence
Cysteine regulated genes were compared with available literature. Genes from a heat shock study  had significant overlap with peroxide stress  (p<0.0001; binomial distribution probability). Since both studies investigated stress stimuli they were compiled into a single group (‘stress’) for the comparison with cysteine depletion. In addition, studies on iron depletion  and two host interaction studies ,  were compiled to ‘virulence’ based on significant overlap (p<0.0001). Studies on restrictive oxygen conditions  and putative pathogenicity genes  were not used due to insufficient overlap with cysteine regulated genes and/or available literature. The compiled gene sets ‘stress’ and ‘virulence’ were then compared with the cysteine depletion genes, revealing a significant overlap between the 3 groups (p<0.0001). The overlap indicates that similar mechanisms may be involved in these biological events (Figure 2A). Functional annotation of 149 cysteine regulated genes revealed 36 enriched Gene Ontologies (p<0.05), related to 11 functional groups (Figure 2B). Functional groups with distinct expression patterns were sulfur metabolism (9/9 genes upregulated), iron-sulfur cluster (6/6 upregulated), translation (13/16 downregulated), metal ion uptake (11/16 upregulated), cell wall (3/3 downregulated) and stress (2/2 upregulated). Non-distinct patterns were observed for redox (27 genes), membrane transport (23 genes), amino acid biosynthesis (10 genes), energy metabolism (4 genes) and other functions (19 genes). Some functional groups were directly related to the experimental context, like sulfur metabolism and amino acid biosynthesis (cysteine depletion), downregulated translation machinery (stationary growth) or membrane transport (upregulated sulfate uptake genes). The remaining functional groups were primarily related to oxidative stress (redox, iron-sulfur cluster, metal ion uptake and stress). Details are listed in Table S1.
Intracellular effects of cysteine depletion were explored with transcriptome analysis, resulting in 149 significantly regulated genes. (A) Significant overlap is found (p<0.0001) between cysteine regulated genes and relevant literature (compiled gene sets ‘stress’ ,  and ‘virulence’ , ), indicating that similar mechanisms are involved in these different stimuli. (B) Functional annotation of cysteine regulated genes identified 36 enriched Gene Ontologies (p<0.05) from 11 functional groups. In addition to expected groups like sulfur metabolism or translation, several functional groups are related to oxidative stress (i.e. redox or iron-sulfur cluster). Therefore it is hypothesized that cysteine depletion impaires the sulfur supply for iron-sulfur protein biogenesis, ultimately resulting in oxidative stress. Details of the transcriptome analysis are provided in Figure S3 (principal component analysis and gene clustering) and Table S1 (expression data with functional annotation).
Cysteine Depletion Triggers Increased sOMV Release
Based on the transcriptome results it was hypothesized that in addition to growth arrest, cysteine depletion causes oxidative stress as an intracellular signal for sOMV release. The hypothesis was verified with a medium repletion experiment in shake flasks (Figure 3). Precultures on control medium with the normal amount of cysteine were pooled and repleted with control medium or medium without cysteine (two groups). A third group was repleted with control medium but growth was repressed with peroxide to induce oxidative stress. Repleted cultures were monitored for growth and sOMV release. The sOMV were measured in small culture supernatant samples (sterile filtered; <3 mL) with a fluorescent probe that specifically binds phospholipid bilayer structures. Biomass concentration of the pooled preculture (0.78 gdw/L) was comparable to the biomass density directly after repletion (0.76±0.05 gdw/L), indicating that no biomass losses ocurred during the repletion procedure. Shake flasks that were repleted with control medium continued growth to a final dry biomass concentration of 3.75±0.02 gdw/L. Cysteine depleted and oxidative stress shake flasks did not grow, resulting in final biomass concentrations of 0.64±0.01 and 1.28±0.20 gdw/L, respectively (Figure 3A). The sOMV results however revealed opposite effects. Control shake flasks grew normally but had a low specific sOMV yield of 1.1±0.2 mg PorA antigen/gdw, while the cysteine depleted shake flasks yielded 13.7±1.3 mg PorA/gdw (with a constant sOMV release rate). Oxidative stress shake flasks temporarily released sOMV after each peroxide addition (variable sOMV release rate) resulting in an intermediate yield (7.7±0.8 mg PorA/gdw; Figure 3B). Shake flasks were harvested before cysteine in the control medium was exhausted, to prevent unintended sOMV release. Integrity of sOMV in the culture supernatant was confirmed with dynamic light scattering (DLS), which measured a distinct peak around 100 nm indicating that the bacteria were not desintegrating while releasing the OMV (data not shown). The above results demonstrate that cysteine depletion triggers increased sOMV release. Other stress stimuli like growth repression with peroxide can mimic this effect.
The effect of cysteine depletion on sOMV release is demonstrated with a repletion experiment in shakeflasks. (A) Pre-cultures are grown on control medium with cysteine (circles). Harvested cells are repleted with control medium (circles) or medium without cysteine (triangles). Shake flasks without cysteine enter the stationary phase, while cysteine repleted flasks continue growth normally. A third group (squares) is repleted with control medium, but growth is repressed with peroxide to mimic oxidative stress and verify the transcriptome data (arrows indicate peroxide additions). Y-axis represents dry biomass concentration (g dry weight per L). (B) Vesicle release in the cultivation supernatant is monitored with a fluorescent probe up to 6 hours after repletion. Shake flasks with control medium grow normally but do not release sOMV, while cysteine depletion triggers a sustained release of vesicles. Oxidative stress has a similar but transient effect, since sOMV are released temporarily after each peroxide addition. Cysteine depletion is therefore an external stimulus for sOMV release, which induces oxidative stress as the intracellular signal. Y-axis represents specific sOMV yield (mg PorA antigen per g dry weight).
Cysteine Depletion Approach is Feasible for sOMV Vaccine Production
The shake flask repletion experiment measured sOMV yield directly in the supernatant without taking purification losses or vaccine quality into account. To assess whether the cysteine depletion approach was feasible for vaccine production, larger samples (250–400 mL) were taken from a bioreactor system to purify eOMV (reference vaccine) and sOMV (experimental vaccine) in parallel, according to the protocol in Figure S1. Purifications were done at several time points before and after cysteine depletion. The cultivations were monitored to measure biomass concentration and cysteine (time points A to N). As observed in shake flasks, biomass growth during the exponential phase was reproducible for all 6 replicate bioreactor cultivations (R2 = 0.975) and growth arrest ocurred upon cysteine depletion (time point G; Figure 4A).
A novel approach for the production of sOMV vaccine against N. meningitidis serogroup B is explored by utilizing the effect of cysteine depletion. (A) Biomass concentration (closed circles) is monitored in bioreactor cultivations (time points A to N). Time point G marks onset of stationary growth, caused by depletion of cysteine (open circles). (B) Yield of purified sOMV vaccine (black bars) is compared with eOMV reference vaccine, which uses detergent-free biomass extraction to improve yield (white bars). Several time points before (D, F) and after (I, K, M) cysteine depletion are included. After cysteine depletion, sOMV yield increases gradually to quantities that are comparable to the eOMV reference (no significant difference at time point M). Significant yield differences are indicated with asterikses (p<0.05). ‘NS’ indicates a non-significant difference.
Purification of eOMV and sOMV vaccines was performed at time points D, F (before) and I, K, M (after cysteine depletion). Yield of purified eOMV (reference) correlated to the amount of biomass that was used, resulting in a constant amount of 6.3±0.3 mg PorA antigen/gdw regardless nutrient availability (Figure 4B). Yield of purified sOMV however depended on cysteine availability. Before depletion the yield was just above detection limit (0.2±0.1 and 0.3±0.1 mg PorA/gdw, respectively). Cysteine depletion then triggered sOMV release resulting in a cumulative increase during time point I (0.9±0.4 mg PorA/gdw), time point K (2.0±0.4 mg/gdw) and time point M (4.3±1.4 mg/gdw). The reference yield (eOMV) was significantly higher than sOMV at most time points (D, F, I and K; p<0.001) but no significant difference was found at time point M, indicating that the cysteine depletion approach can generate sufficient sOMV for feasible vaccine production. Protein composition and vesicle size distribution were measured to assess vaccine quality. Purified eOMV had a comparable overall protein compositon at all time points, with a high PorA antigen content (64±3% of total protein; Figure 5A). Purified sOMV were comparable to eOMV at time points F, I, K and M (PorA content 61±5%), but time point D had a low and variable purity (43±23%) caused by a yield that was below the threshold for reliable analysis. Vesicle size averages of eOMV (reference) and sOMV samples were comparable (83±5 and 97±9 nm respectively). The sOMV samples however had a slightly broader size distribution and contained minor particle peaks at ∼5 µm, indicating that the purification procedure may require improvements (Figure 5B).
In addition to yield, quality of the sOMV and eOMV vaccines is compared. It was previously demonstrated that both vaccine types provide low toxicity and high functional immunogenicity in mice . (A) Protein composition of eOMV reference vaccines is comparable to sOMV vaccines after cysteine depletion (time points I, K, M). Each lane contains 4 µg total protein, except sOMV at time points D and F (low protein concentration due to a low yield; maximal sample volume is loaded). PorA antigen (∼41 kD) has a major contribution to total protein content (>60%) in all vaccines. (B) Dynamic light scattering analysis reveals that sOMV vaccines have a slightly broader size distribution and minor aggregation compared to the eOMV references, indicating that the purification procedure is not yet fully consistent. X-axis represents vesicle size distribution (nm).
This study with Neisseria meningitidis demonstrates that cysteine depletion can trigger growth arrest and the release of outer membrane vesicles (OMV) in sufficient quantities for vaccine production. The vesicles are released spontaneously (sOMV) and are as similar to in vivo vesicles as possible with a production system for human vaccines . Therefore the obtained results may be relevant for the in vivo vesiculation and pathogenesis of N. meningitidis. To our knowledge, external stimuli that trigger sOMV release were not previously described for N. meningitidis or for cysteine as the limiting nutrient. Cysteine was found to be the growth-limiting component of human serum when supplemented to a chemically defined medium . In serum-free media, some strains had an absolute cysteine requirement but others were able to grow on a variety of sulfur sources after adaptation , . The vaccine production strain in this study is unable to adapt its sulfur metabolism after cysteine depletion, resulting in stationary growth despite a genetic ability to use alternate sulfur sources from the medium (Figure 1). The strain has specific mutations to express multiple protective PorA antigens, attenuate LPS toxicity and improve OMV yield, which are required for detergent-free vaccine production . These mutations however may cause an inability to adapt to cysteine depleted conditions, since previous work with a strain that resembled the H44/76 parent strain more closely did not reveal an absolute cysteine requirement for growth .
Nutrient depletion was not previously associated with increased sOMV release by N. meningitidis, but specific genetic modifications are known to have a comparable outcome. The strain in this study has a disrupted rmpM gene to prevent anchoring of the outer membrane to the peptidoglycan layer with an OmpA-like domain , , . The gna33 mutation increases vesiculation through an unknown mechanism . External stimuli for vesiculation have been identified in E. coli, including heat shock, lysine depletion or conditions that activate the σE envelope stress response pathway , , , . In agreement with these observations, this study identified an external stress stimulus for N. meningitidis vesiculation. It remains unknown to what extent the current results are restricted to cysteine as the depleted nutrient or to this specific N. meningitidis strain.
Transcriptome analysis was performed to elucidate the intracellular effects of cysteine depletion in more detail. The transcriptome profile resembles studies with N. meningitidis that investigated stress ,  and virulence stimuli , ,  (Figure 2). Functional annotation revealed several pathways that are directly related to cysteine depletion or a decreased growth rate. The remaining pathways are related to oxidative stress, with a central role for iron-sulfur protein biogenesis. Iron-sulfur proteins are highly conserved in prokaryotes and eukaryotes. Mutants with an impaired biogenesis accumulate free intracellular iron and produce reactive oxygen species (ROS), which causes oxidative stress , . In addition, iron-sulfur protein biogenesis requires sulfur acquisition and storage protein for free iron , . These aspects are all represented by genes that are upregulated after cysteine depletion, including iron-sulfur cluster assembly (erpA, nifU), cysteine synthase/desulfurase (cysK, iscS), storage of Fe2+ ions (bfrA), ROS scavenging (sodB, sodC) and several reductases. Therefore it is hypothesized that impaired iron-sulfur protein biogenesis also occurs in N. meningitidis after cysteine depletion, causing increased intracellular iron levels and oxidative stress.
Recent work by our group showed that sOMV release by N. meningitidis increased significantly during the stationary growth phase, but the mechanism was not fully understood . By comparing cysteine repleted with depleted conditions, this study demonstrates that cysteine depletion is the trigger for onset of stationary growth and increased sOMV release (Figure 3). It also shows that growth repression with oxidative stress, the hypothesised outcome of cysteine depletion, mimics this effect temporarily. Release of sOMV increases directly after each peroxide addition but then stabilizes, while cysteine depletion results in sustained vesicle release. Also, the peroxide dose range is narrow and critical for bacterial viability (data not shown). Despite these limitations, the results confirm involvement of oxidative stress as an intracellular signal for sOMV release and support the transcriptome data. N. meningitidis encounters oxidative stress in vivo, when phagocytes use ‘oxidative burst’ to eliminate the invading pathogen , . In such conditions vesiculation may provide decoys for phagocytosis and enhance bacterial survival.
This study provides a novel approach for the production of sOMV vaccine against N. meningitidis serogroup B, in which onset of stationary growth and vesiculation is determined by the cysteine concentration of the growth medium. The use of a synthetic medium with a single growth-limiting component greatly improves process control. Other media for N. meningitidis have unidentified limiting nutrients and contain undefined components like casamino acids, resulting in less predictable growth , , . Purification of sOMV does not require concentration, resuspension or extraction of the bacterial biomass (Figure S1). These steps are labour intensive and complicate processing, especially when translated to large-scale processes. Therefore sOMV purification is the preferred approach for process development. To assess feasibility, yield and quality of sOMV vaccines were compared with eOMV references at several time points before and after cysteine depletion. In agreement with the initial observations (Figure 3), sOMV release is triggered after cysteine depletion and then increases over time. Final yield is comparable to the eOMV reference, indicating that cysteine depletion can also provide a feasible yield (Figure 4; ±1500 human doses sOMV vaccine per L cultivation). The sOMV have a slightly broader size distribution, indicating that the purification procedure is not yet fully consistent. This procedure may improve by replacing the centrifugal ultrafiltration units with more robust and scalable equipment like tangential flow ultrafiltration .
In conclusion, this study shows that cysteine depletion can trigger growth arrest and outer membrane vesicle release by N. meningitidis. Transcriptome data suggests a relation between cysteine depletion and impaired iron-sulfur protein assembly, resulting in oxidative stress. This hypothesis is substantiated by showing that induced oxidative stress during cysteine-rich growth also triggers vesiculation. Cysteine depletion improves the production of a vaccine against serogroup B meningococcal disease, resulting in substantial amounts of sOMV. Since the sOMV are more similar to vesicles from natural infection, cysteine-dependent vesiculation is likely to be relevant for the in vivo pathogenesis of N. meningitidis.
Materials and Methods
Bacterial Strain and Shake Flask Cultivations
The N. meningitidis vaccine strain that was used is a recombinant variant of serogroup B isolate H44/76 , combining one wild-type and two recombinant PorA antigens (trivalent PorA; subtypes P1.7,16; P1.5–1,2–2 and P1.19,15–1) with a non-functional porB gene . The cps locus was deleted, resulting in a non-encapsulated phenotype with galE-truncated LPS. Additional deletions in lpxL1 and rmpM genes attenuate LPS toxicity and improve yield . All cultures were grown in chemically defined growth medium . For shake flask cultivations, 150 mL pre-culture was inoculated with 10 mL working seedlot (cells at OD590 = 1.5±0.1; stored at −135°C with glycerol) and incubated in 500 mL erlenmeyer shake flasks (Nalgene, Rochester NY, U.S.A.) at 35°C, 200 rpm. At an OD590 of 1.5±0.3, 10 mL portions from the pre-culture shake flask were used to inoculate several secondary shake flasks, containing media with different arginine and cysteine concentrations (for Figure 1). Alternatively, secondary shake flasks with normal medium were grown to an OD590 of 2.5±0.3 for repletion experiments (for Figure 3). Shake flasks for Figure 3 were pooled and centrifuged in 150 mL portions (20 min.; 3000×g; 4°C). Pellets were resuspended, washed in 75 mL medium (with/without cysteine) and re-centrifuged. The depletion/repletion experiments started after resuspending the pellets in 150 mL medium with/without cysteine. To induce oxidative stress, 150 µM peroxide was added to each shake flask (triplicates) directly after depletion/repletion (t = 0). Growth was then monitored with hourly OD590 measurements. If the average optical density increased >10% between 2 measurements, 50 µM peroxide was added to repress growth. This was necessary at t = 2.5 and 5.5 hours after depletion/repletion (arrows in Figure 3).
Transcriptome analysis (Figure 2) and OMV production (Figure 4) was performed on samples from a fully instrumented, 5 L benchtop bioreactor (Applikon, Schiedam, The Netherlands) with 6-blade Rushton impeller for mixing and gas dispersion and initial working volume of 3.5 L. Controller set points were 35.0±0.5°C (temperature), 30±5% (dissolved oxygen concentration), 7.2±0.1 (pH), 300–750 rpm (stirrer speed). The bioreactor was inoculated with 150 mL pre-culture at OD590 = 1.5±0.3. The bioreactor was connected to an ADI-1040 control system (Applikon), operated with BCSV software (Compex, Gent, Belgium). After inoculation, dissolved oxygen concentration was first controlled by gradually increasing stirrer speed to 750 rpm. Then the fraction of oxygen in the headspace increased gradually while maintaining a constant total gas flow of 1.0 L/min. Samples for nutrient analysis were sterile filtered (0.22 µm) and stored at 4°C.
Transcriptome analysis was performed as described previously , . RNA were analysed with a full-genome N. meningitidis MC58 microarray , which covered 93% of predicted ORFs (Operon, Köln, Germany). Oligonucleotides were spotted in triplicate on UltraGAPS II coated slides (Corning, Corning NY, USA). The transcriptome profile was preserved by mixing 1 volume of bacterial culture (corresonding to 2.5 mL at OD590 = 1) with 2 volumes of RNA-later solution (Ambion, Paisley, United Kingdom), then concentrated with centrifugation (20 min.; 3000×g; 4°C) and stored at −80°C until RNA extraction. Bacterial pellets were thawed and pre-treated in Tris-EDTA buffer with 0.5 mg/mL lysozyme (Sigma–Aldrich, Zwijndrecht, The Netherlands) prior to RNA extraction according to manufacturer’s protocol (SV Total RNA isolation kit; Promega, Fitchburg WI, USA). Nucleic acid concentration was adjusted with ethanol precipitation and spectral analysis was used to determine purity and concentration. RNA integrity was measured with the Bioanalyzer RNA6000 Nano assay (Agilent Technologies, Santa Clara CA, USA), according to the manufacturers’ protocol. RNA integrity number (RIN) scores were used to assess RNA integrity (score >8.0 required for inclusion) . Total RNA from triplicate samples at each time point were reverse transcribed to cDNA and labelled with Cy3 dye using the Chipshot Indirect Labeling and Clean-Up kit (Promega), according to the manufacturer’s protocol. Common reference samples, containing equal amounts of total RNA from all experimental samples, were labelled with Cy5. The labelled and purified cDNA samples were pooled in Cy3/Cy5 pairs. Hybridization buffer was added to a final concentration of 25% formamide, 56 SSC and 0.1% SDS. Samples were applied to the microarray slides and incubated in a hybridization chamber (16–20 h; 42°C; dark). Differential gene expression was calculated through comparison with the common reference. Microarrays were scanned with a ScanArray Express microarray scanner (Perkin Elmer, Waltham MA, USA) and median fluorescence intensities were quantified for each spot using ArrayVision software (Imaging Research). The data was natural-log transformed, quantile normalized and values of replicate spots were averaged. These data processing steps were done with the statistical software R, using an in-house developed script. P-values were calculated with one-way ANOVA statistical analysis. Significantly regulated genes were selected with a False Discovery Rate (FDR) of <10% to adjust p-values for multiple testing. Fold ratio (FR) values were expressed as the natural log of the normalized signal difference between the two groups. To further select for biologically relevant effects, a FR threshold of >2.0 (untransformed value) was applied to obtain the final results. Gene annotations were obtained from Uniprot Knowledge Base (www.uniprot.org; N. meningitidis MC58; version July 2011). Principal component analysis (PCA) and clustering of differentially expressed genes in expression groups was performed with Genemaths XT software (Applied Maths, Sint-Martens-Latem, Belgium). Overall gene expression differences between samples were assessed by calculating the Euclidian distance between gene expression values over the entire set of genes (this corresponds to the distance in a PCA plot). Functional annotations of cysteine regulated genes were retrieved from the Gene Ontology database, using corresponding Uniprot protein IDs (www.geneontology.org; version February 2012). Enrichment for a specific Gene Ontology was assessed by comparing the number of hits in the cysteine dataset with the number of hits in the MC58 genome. Enrichment p-values were obtained by calculating the binomial distrbution probability. The binomial distribution probability was also used to calculate a p-value for the overlap between gene lists, allowing comparison of the cysteine dataset with relevant literature.
OMV Purification and Characterization
This study used small-scale, detergent-free OMV purifications as described previously . Cultivation samples (250–400 mL) were taken from the bioreactor and purified. The samples were split in supernatant (sOMV) and pellet (eOMV) with centrifugation (20 min.; 3000×g; 4°C). To purify sOMV, supernatant was sterile filtered (0.22 µm) and concentrated with ultrafiltration (UF), using centrifugal units with 100 kD cutoff (Centricon 70-plus Ultracell, Millipore, Billerica MA, USA). UF units were washed with saline, filled with 70 mL supernatant and concentrated to 10–15 mL by centrifugation. The retentate was re-diluted to 70 mL with fresh supernatant and the cycle was repeated until the full sample was processed (centrifugation at 1500×g; 4°C). Final retentate was diluted to 70 mL with storage buffer and concentrated to 10 mL (first wash step). The sOMV in the retentate were then pelleted with ultracentrifugation (120 min.; 125000×g; 4°C) and resuspended in a suitable volume of storage buffer (second wash step). To purify eOMV, the bacterial pellet was resuspended in 7.5 volumes (mL/g wet weight) of EDTA buffer (100 mM Tris-HCl pH8.6 with 10 mM EDTA) and incubated (30 min. ambient temperature). Cells were discarded by semi high-speed centrifugation (75 min.; 20000×g; 4°C). Ultracentrifugation was used to pellet eOMV in the supernatant (120 min.; 125000×g; 4°C) and the pellet was resuspended in a suitable volume of storage buffer. Final total protein concentration was 1.0±0.5 mg/mL for all OMV samples. Total protein concentration, PorA quantity and vesicle size distribution of OMV samples were performed as described previously , . Briefly, total protein concentration was measured with the Lowry protein assay. Peterson’s modification was used to reduce the effect of interfering substances. PorA antigen content was determined by SDS gel electrophoresis, followed by total protein staining and quantification of the 40–44 kD bands (PorA). Gels were stained with Novex Colloidal Blue (Invitrogen, Breda, The Netherlands) and PorA was quantified as a percentage of total protein using TL100 1D gel analysis software (Totallab, Newcastle upon Tyne, U.K.). Vesicle size distribution was measured with dynamic light scattering (DLS) at 25°C with a Malvern 4700 system. Homogeneity of the vesicle size distribution was reflected in the polydispersity index (PdI), which ranges between 0.0 (fully homogeneous size distribution) and 1.0 (random size distribution).
Quantification of Nutrients and sOMV Release
Cysteine (after reaction with bromoacetic acid and reduction using tris(2-ethylcarboxy)phosphine (TCEP)) and arginine were quantified by HPLC after derivatisation with orthophtalic anhydride (OPA). Release of sOMV in the culture supernatant was monitored by using the fluorescent signal of a phospholipid-specific probe (SynaptoRed C2, Biotium, Hayward, CA, USA; ex500, em650). An aqueous solution of SynaptoRed C2 (0.05 mM, 50 µL) was mixed with 50 µL of sterile filtered culture supernatant or OMV standard with a known concentration. Fluorescence of the resulting mixture was recorded in black microtiter plates using a fluorometer (Synergy MX microplate reader; Biotek, Bad Friedrichshall, Germany). A calibration curve was constructed from the responses of the standards (dilutions of purified eOMV standard corresponding to 0–10 mg/L PorA antigen). Concentration of sOMV in culture supernatant samples was calculated from this calibration curve.
Detergent-free OMV purification. There are two different detergent-free OMV purification types; sOMV (spontaneously released OMV) are purified from the culture supernatant without additional treatments to enhance vesicle release, while eOMV (extracted OMV) are obtained after detergent-free extraction of the bacterial biomass with a chelating agent (EDTA). Therefore both OMV types can be purified in parallel from a single cultivation. This study uses eOMV as a reference for high yield and quality . Cultivation harvest was split in supernatant and bacterial pellet with low speed centrifugation. The supernatant was sterilized with filtration, then sOMV were concentrated with ultrafiltration and pelleted with ultracentrifugation. Purified sOMV were resuspended in a suitable volume of storage buffer. The bacterial pellet was resuspended in EDTA extraction buffer to release eOMV. Cells were incubated and discarded with semi high-speed centrifugation. Ultracentrifugation was used to concentrate eOMV and the pellet was resuspended in a suitable volume of storage buffer. Purification of eOMV requires several complicated steps in terms of handling (concentration, resuspension and extraction of the bacterial biomass). Therefore sOMV purification is the preferred approach for process development.
Nutrient monitoring identifies the growth-limiting medium component. Media with different combinations of cysteine (cys) and arginine (arg) are tested to determine the growth-limiting component. Upper plots represent nutrient concentrations in media with normal cys, while the lower plots represent media with low cys. Media with normal or low arg are indicated with circles or triangles, respectively. Y-axes represent cys concentration (plots on the left) or arg concentration (plots on the right), The X-axis represents cultivation time, with t = 0 as the expected time point of growth arrest (confirmed for control medium with normal amounts of cys and arg; upper left plot, circles). Grey vertical lines indicate the observed growth arrest time point (obtained from Figure 1). The results demonstrate that growth arrest depends on cys availability and is independent of arg.
Detailed transcriptome analysis. (A) Principal component analysis was performed on the full transcriptome to asses reproducibility of replicates and identify sources of variation in the dataset (principal components, or PCs). The analysis shows that PC1 and PC2 explain 70% and 7% of total variation in the dataset, respectively, while the remaining PCs explained <5% each. PC1 represents cysteine availability because all samples before depletion (t = −2.5 h (white circles), t = −1.2 h (grey circles) and t = −0.4 h (black circles)) have a high score, while depleted samples (t = +1.4 h (white triangles) and t = +3.5 h (black triangles)) have a low score. This indicates that the experimental treatment accounts for the majority of variation in the data. All biological replicates have comparable PC1 and PC2 coordinates, indicating high reproducibility. (B) Significant effects in the dataset were initially selected with a False Discovery Rate threshold (FDR <0.10). To refine for biologically relevant effects, a Fold Ratio filter was used (FR >2.0). Clustering of the resulting 149 cysteine regulated genes reveals 3 expression groups: downregulated after cysteine depletion (48 genes), upregulated after depletion (90 genes) and 11 genes with a variable expression pattern. For further interpretation of the results, functional properties of the cysteine regulated genes were assessed. This resulted in 36 enriched Gene Ontologies (p<0.05) from 11 functional groups (Table S1).
Cysteine regulated genes with functional annotation. (A) List of all genes that are differentially expressed after cysteine depletion. Each entry contains accession number, gene name, gene symbol, expression data (pattern and statistics) and details of the functional annotation (enriched Gene Ontology numbers and corresponding functional groups). (B) Overview of enriched Gene Ontologies in the cysteine depletion dataset. Each entry contains Gene Ontology ID, name and corresponding functional group. The statistics section shows the number of hits for each Gene Ontology in the cysteine depletion dataset and the total number of hits in the MC58 genome. Based on both counts, an enrichment p-value is calculated by using the binomial distribution probability. Only Gene Ontologies with significant p-values (<0.05) are included in the list.
The authors gratefully acknowledge Alex de Haan for performing nutrient analyses, Martin Hamzink for quantification of sOMV release in culture supernatants and Mariken Segers for helpful discussion.
Conceived and designed the experiments: BW GZ LP. Performed the experiments: LK JIJ BW. Analyzed the data: BW. Wrote the paper: BW PL ME.
- 1. Ellis TN, Kuehn MJ (2010) Virulence and immunomodulatory roles of bacterial outer membrane vesicles. Microbiol Mol Biol Rev 74: 81–94.
- 2. Deatherage BL, Lara JC, Bergsbaken T, Rassoulian Barrett SL, Lara S, et al. (2009) Biogenesis of bacterial membrane vesicles. Mol Microbiol 72: 1395–1407.
- 3. Unal CM, Schaar V, Riesbeck K (2011) Bacterial outer membrane vesicles in disease and preventive medicine. Semin Immunopathol 33: 395–408.
- 4. Namork E, Brandtzaeg P (2002) Fatal meningococcal septicaemia with “blebbing” meningococcus. Lancet 360: 1741.
- 5. Kulp A, Kuehn MJ (2010) Biological functions and biogenesis of secreted bacterial Outer Membrane Vesicles. Annual Review of Microbiology 64: 163–184.
- 6. Sierra GV, Campa HC, Varcacel NM, Garcia IL, Izquierdo PL, et al.. (1991) Vaccine against group B Neisseria meningitidis: protection trial and mass vaccination results in Cuba. NIPH Ann 14: 195–207; discussion 208–110.
- 7. Bjune G, Hoiby EA, Gronnesby JK, Arnesen O, Fredriksen JH, et al. (1991) Effect of outer membrane vesicle vaccine against group B meningococcal disease in Norway. Lancet 338: 1093–1096.
- 8. Thornton V, Lennon D, Rasanathan K, O’Hallahan J, Oster P, et al. (2006) Safety and immunogenicity of New Zealand strain meningococcal serogroup B OMV vaccine in healthy adults: beginning of epidemic control. Vaccine 24: 1395–1400.
- 9. Holst J, Martin D, Arnold R, Huergo CC, Oster P, et al. (2009) Properties and clinical performance of vaccines containing outer membrane vesicles from Neisseria meningitidis. Vaccine 27 Suppl 2B3–12.
- 10. Claassen I, Meylis J, van der Ley P, Peeters C, Brons H, et al. (1996) Production, characterization and control of a Neisseria meningitidis hexavalent class 1 outer membrane protein containing vesicle vaccine. Vaccine 14: 1001–1008.
- 11. van de Waterbeemd B, Streefland M, van der Ley P, Zomer B, van Dijken H, et al. (2010) Improved OMV vaccine against Neisseria meningitidis using genetically engineered strains and a detergent-free purification process. Vaccine 28: 4810–4816.
- 12. Ferrari G, Garaguso I, Adu-Bobie J, Doro F, Taddei AR, et al. (2006) Outer membrane vesicles from group B Neisseria meningitidis delta gna33 mutant: proteomic and immunological comparison with detergent-derived outer membrane vesicles. Proteomics 6: 1856–1866.
- 13. van der Ley P, Steeghs L, Hamstra HJ, ten Hove J, Zomer B, et al. (2001) Modification of lipid A biosynthesis in Neisseria meningitidis lpxL mutants: influence on lipopolysaccharide structure, toxicity, and adjuvant activity. Infect Immun 69: 5981–5990.
- 14. Koeberling O, Seubert A, Granoff DM (2008) Bactericidal antibody responses elicited by a meningococcal outer membrane vesicle vaccine with overexpressed factor H-binding protein and genetically attenuated endotoxin. J Infect Dis 198: 262–270.
- 15. Keiser PB, Biggs-Cicatelli S, Moran EE, Schmiel DH, Pinto VB, et al.. (2010) A phase 1 study of a meningococcal native outer membrane vesicle vaccine made from a group B strain with deleted lpxL1 and synX, over-expressed factor H binding protein, two PorAs and stabilized OpcA expression. Vaccine.
- 16. Weynants V, Denoel P, Devos N, Janssens D, Feron C, et al. (2009) Genetically modified L3,7 and L2 lipooligosaccharides from Neisseria meningitidis serogroup B confer a broad cross-bactericidal response. Infect Immun 77: 2084–2093.
- 17. Zollinger WD, Donets MA, Schmiel DH, Pinto VB, Labrie J, et al.. (2010) Design and evaluation in mice of a broadly protective meningococcal group B native outer membrane vesicle vaccine. Vaccine.
- 18. Koeberling O, Giuntini S, Seubert A, Granoff DM (2008) Meningococcal OMV Vaccines from Mutant Strains Engineered to Express Factor H Binding Proteins from Antigenic Variant Groups 1 and 2. Clin Vaccine Immunol.
- 19. van der Ley P, van den Dobbelsteen G (2011) Next-generation outer membrane vesicle vaccines against Neisseria meningitidis based on nontoxic LPS mutants. Hum Vaccin 7: 886–890.
- 20. Zollinger WD, Poolman JT, Maiden MC (2011) Meningococcal serogroup B vaccines: will they live up to expectations? Expert Rev Vaccines 10: 559–561.
- 21. Post DM, Zhang D, Eastvold JS, Teghanemt A, Gibson BW, et al. (2005) Biochemical and functional characterization of membrane blebs purified from Neisseria meningitidis serogroup B. J Biol Chem. 280: 38383–38394.
- 22. Hoekstra D, van der Laan JW, de Leij L, Witholt B (1976) Release of outer membrane fragments from normally growing Escherichia coli. Biochim Biophys Acta 455: 889–899.
- 23. van de Waterbeemd B, Streefland M, van Keulen L, van den IJssel J, de Haan A, et al. (2012) Identification and optimization of critical process parameters for the production of NOMV vaccine against Neisseria meningitidis. Vaccine 30: 3683–3690.
- 24. Prachayasittikul V, Isarankura-Na-Ayudhya C, Tantimongcolwat T, Nantasenamat C, Galla HJ (2007) EDTA-induced membrane fluidization and destabilization: biophysical studies on artificial lipid membranes. Acta Biochim Biophys Sin (Shanghai) 39: 901–913.
- 25. Haque H, Russell AD (1974) Effect of chelating agents on the susceptibility of some strains of gram-negative bacteria to some antibacterial agents. Antimicrob Agents Chemother 6: 200–206.
- 26. Haque H, Russell AD (1974) Effect of ethylenediaminetetraacetic acid and related chelating agents on whole cells of gram-negative bacteria. Antimicrob Agents Chemother 5: 447–452.
- 27. Zollinger WD, Kasper DL, Veltri BJ, Artenstein MS (1972) Isolation and characterization of a native cell wall complex from Neisseria meningitidis. Infect Immun 6: 835–851.
- 28. Work E, Knox KW, Vesk M (1966) The chemistry and electron microscopy of an extracellular lipopolysaccharide from Escherichia coli. Ann N Y Acad Sci 133: 438–449.
- 29. Chatterjee SN, Das J (1967) Electron microscopic observations on the excretion of cell-wall material by Vibrio cholerae. J Gen Microbiol 49: 1–11.
- 30. Henry T, Pommier S, Journet L, Bernadac A, Gorvel JP, et al. (2004) Improved methods for producing outer membrane vesicles in Gram-negative bacteria. Res Microbiol 155: 437–446.
- 31. Katsui N, Tsuchido T, Hiramatsu R, Fujikawa S, Takano M, et al. (1982) Heat-induced blebbing and vesiculation of the outer membrane of Escherichia coli. J Bacteriol 151: 1523–1531.
- 32. McBroom AJ, Kuehn MJ (2007) Release of outer membrane vesicles by Gram-negative bacteria is a novel envelope stress response. Mol Microbiol 63: 545–558.
- 33. Bishop DG, Work E (1965) An extracellular glycolipid produced by Escherichia coli grown under lysine-limiting conditions. Biochem J 96: 567–576.
- 34. Knox KW, Vesk M, Work E (1966) Relation between excreted lipopolysaccharide complexes and surface structures of a lysine-limited culture of Escherichia coli. J Bacteriol 92: 1206–1217.
- 35. Guckenberger M, Kurz S, Aepinus C, Theiss S, Haller S, et al. (2002) Analysis of the heat shock response of Neisseria meningitidis with cDNA- and oligonucleotide-based DNA microarrays. J Bacteriol 184: 2546–2551.
- 36. Grifantini R, Frigimelica E, Delany I, Bartolini E, Giovinazzi S, et al. (2004) Characterization of a novel Neisseria meningitidis Fur and iron-regulated operon required for protection from oxidative stress: utility of DNA microarray in the assignment of the biological role of hypothetical genes. Mol Microbiol 54: 962–979.
- 37. Grifantini R, Sebastian S, Frigimelica E, Draghi M, Bartolini E, et al. (2003) Identification of iron-activated and -repressed Fur-dependent genes by transcriptome analysis of Neisseria meningitidis group B. Proc Natl Acad Sci U S A. 100: 9542–9547.
- 38. Grifantini R, Bartolini E, Muzzi A, Draghi M, Frigimelica E, et al. (2002) Previously unrecognized vaccine candidates against group B meningococcus identified by DNA microarrays. Nat Biotechnol 20: 914–921.
- 39. Dietrich G, Kurz S, Hubner C, Aepinus C, Theiss S, et al. (2003) Transcriptome analysis of Neisseria meningitidis during infection. J Bacteriol 185: 155–164.
- 40. Bartolini E, Frigimelica E, Giovinazzi S, Galli G, Shaik Y, et al. (2006) Role of FNR and FNR-regulated, sugar fermentation genes in Neisseria meningitidis infection. Mol Microbiol 60: 963–972.
- 41. Tettelin H, Saunders NJ, Heidelberg J, Jeffries AC, Nelson KE, et al. (2000) Complete genome sequence of Neisseria meningitidis serogroup B strain MC58. Science 287: 1809–1815.
- 42. Holbein BE (1981) Growth and surface binding of proteins by Neisseria meningitidis in normal human serum. Current Microbiology 6: 213–216.
- 43. Catlin BW (1973) Nutritional profiles of Neisseria gonorrhoeae, Neisseria meningitidis, and Neisseria lactamica in chemically defined media and the use of growth requirements for gonococcal typing. J Infect Dis 128: 178–194.
- 44. Port JL, DeVoe IW, Archibald FS (1984) Sulphur acquisition by Neisseria meningitidis. Can J Microbiol 30: 1453–1457.
- 45. Baart GJ, Zomer B, de Haan A, van der Pol LA, Beuvery EC, et al. (2007) Modeling Neisseria meningitidis metabolism: from genome to metabolic fluxes. Genome Biol 8: R136.
- 46. Grizot S, Buchanan SK (2004) Structure of the OmpA-like domain of RmpM from Neisseria meningitidis. Mol Microbiol 51: 1027–1037.
- 47. Klugman KP, Gotschlich EC, Blake MS (1989) Sequence of the structural gene (rmpM) for the class 4 outer membrane protein of Neisseria meningitidis, homology of the protein to gonococcal protein III and Escherichia coli OmpA, and construction of meningococcal strains that lack class 4 protein. Infect Immun 57: 2066–2071.
- 48. Jang S, Imlay JA (2007) Micromolar intracellular hydrogen peroxide disrupts metabolism by damaging iron-sulfur enzymes. J Biol Chem 282: 929–937.
- 49. Rouault TA, Tong WH (2005) Iron-sulphur cluster biogenesis and mitochondrial iron homeostasis. Nat Rev Mol Cell Biol 6: 345–351.
- 50. Bitoun JP, Wu G, Ding H (2008) Escherichia coli FtnA acts as an iron buffer for re-assembly of iron-sulfur clusters in response to hydrogen peroxide stress. Biometals 21: 693–703.
- 51. Johnson DC, Dean DR, Smith AD, Johnson MK (2005) Structure, function, and formation of biological iron-sulfur clusters. Annu Rev Biochem 74: 247–281.
- 52. Moslen MT (1994) Reactive oxygen species in normal physiology, cell injury and phagocytosis. Adv Exp Med Biol 366: 17–27.
- 53. Ng VH, Cox JS, Sousa AO, MacMicking JD, McKinney JD (2004) Role of KatG catalase-peroxidase in mycobacterial pathogenesis: countering the phagocyte oxidative burst. Mol Microbiol 52: 1291–1302.
- 54. Zollinger WD (2003) Vaccine against gram negative bacteria - US patent: US6,558,677 B2.
- 55. Fredriksen JH, Rosenqvist E, Wedege E, Bryn K, Bjune G, et al.. (1991) Production, characterization and control of MenB-vaccine “Folkehelsa”: an outer membrane vesicle vaccine against group B meningococcal disease. NIPH Ann 14: 67–79; discussion 79–80.
- 56. Berlanda Scorza F, Colucci AM, Maggiore L, Sanzone S, Rossi O, et al. (2012) High yield production process for Shigella outer membrane particles. PLoS One 7: e35616.
- 57. Holten E (1979) Serotypes of Neisseria meningitidis isolated from patients in Norway during the first six months of 1978. J Clin Microbiol 9: 186–188.
- 58. van der Ley P, van der Biezen J, Poolman JT (1995) Construction of Neisseria meningitidis strains carrying multiple chromosomal copies of the porA gene for use in the production of a multivalent outer membrane vesicle vaccine. Vaccine 13: 401–407.
- 59. Baart GJ, de Jong G, Philippi M, van’t Riet K, van der Pol LA, et al. (2007) Scale-up for bulk production of vaccine against meningococcal disease. Vaccine 25: 6399–6408.
- 60. Baart GJ, Langenhof M, van de Waterbeemd B, Hamstra HJ, Zomer B, et al. (2010) Expression of phosphofructokinase in Neisseria meningitidis. Microbiology 156: 530–542.
- 61. van de Waterbeemd B, Streefland M, Pennings J, van der Pol L, Beuvery C, et al. (2009) Gene-expression-based quality scores indicate optimal harvest point in Bordetella pertussis cultivation for vaccine production. Biotechnol Bioeng 103: 900–908.
- 62. Schroeder A, Mueller O, Stocker S, Salowsky R, Leiber M, et al. (2006) The RIN: an RNA integrity number for assigning integrity values to RNA measurements. BMC Mol Biol 7: 3.
- 63. Baart GJ, Willemsen M, Khatami E, de Haan A, Zomer B, et al. (2008) Modeling Neisseria meningitidis B metabolism at different specific growth rates. Biotechnol Bioeng 101: 1022–1035.