Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Field-deployable multiplex detection method of SARS-CoV-2 and influenza virus using loop-mediated isothermal amplification and DNA chromatography

  • Kyoko Hayashida ,

    Roles Conceptualization, Investigation, Writing – original draft

    junya@czc.hokudai.ac.jp (JY); kyouko-h@czc.hokudai.ac.jp (KH)

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, Department of Paraclinical Studies, School of Veterinary Medicine, University of Zambia, Lusaka, Zambia

  • Alejandro Garcia,

    Roles Investigation

    Affiliation UCD Centre for Experimental Pathogen Host Research, University College Dublin, Belfield, Ireland

  • Lavel Chinyama Moonga,

    Roles Investigation, Methodology

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, Department of Paraclinical Studies, School of Veterinary Medicine, University of Zambia, Lusaka, Zambia

  • Tatsuki Sugi,

    Roles Investigation, Methodology, Writing – review & editing

    Affiliation International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan

  • Kodera Takuya,

    Roles Methodology, Resources

    Affiliation TBA Co., LTD, Sendai, Japan

  • Mitsuo Kawase,

    Roles Resources

    Affiliation TBA Co., LTD, Sendai, Japan

  • Fumihiro Kodama,

    Roles Resources

    Affiliation Sapporo City General Hospital, Sapporo, Japan

  • Atsushi Nagasaka,

    Roles Resources

    Affiliation Sapporo City General Hospital, Sapporo, Japan

  • Nobuhisa Ishiguro,

    Roles Resources

    Affiliations Division of Infection Control, Hokkaido University Hospital, Sapporo, Japan, One Health Research Center, Hokkaido University, Sapporo, Japan

  • Ayato Takada,

    Roles Resources, Writing – review & editing

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, One Health Research Center, Hokkaido University, Sapporo, Japan

  • Masahiro Kajihara,

    Roles Resources

    Affiliation International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan

  • Naganori Nao,

    Roles Methodology, Resources, Writing – review & editing

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, One Health Research Center, Hokkaido University, Sapporo, Japan

  • Masashi Shingai,

    Roles Resources, Writing – review & editing

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan

  • Hiroshi Kida,

    Roles Investigation, Project administration

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, Institute for Vaccine Research and Development, Hokkaido University, Sapporo, Japan

  • Yasuhiko Suzuki,

    Roles Project administration, Resources

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, Institute for Vaccine Research and Development, Hokkaido University, Sapporo, Japan

  • William W. Hall,

    Roles Project administration, Resources, Writing – review & editing

    Affiliations International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, Centre for Research in Infectious Diseases, School of Medicine and Medical Science, University College Dublin, Belfield, Ireland, Global Virus Network, Baltimore, Maryland, United States of America

  • Hirofumi Sawa,

    Roles Funding acquisition, Investigation, Writing – review & editing

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, One Health Research Center, Hokkaido University, Sapporo, Japan, Institute for Vaccine Research and Development, Hokkaido University, Sapporo, Japan, Global Virus Network, Baltimore, Maryland, United States of America

  •  [ ... ],
  • Junya Yamagishi

    Roles Conceptualization, Formal analysis, Investigation, Writing – review & editing

    junya@czc.hokudai.ac.jp (JY); kyouko-h@czc.hokudai.ac.jp (KH)

    Affiliations International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, International Collaboration Unit, International Institute for Zoonosis Control, Hokkaido University, Sapporo, Japan, One Health Research Center, Hokkaido University, Sapporo, Japan

  • [ view all ]
  • [ view less ]

Abstract

A novel multiplex loop-mediated isothermal amplification (LAMP) method combined with DNA chromatography was developed for the simultaneous detection of three important respiratory disease-causing viruses: severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), influenza A virus, and influenza B virus. Amplification was performed at a constant temperature, and a positive result was confirmed by a visible colored band. An in-house drying protocol with trehalose was used to prepare the dried format multiplex LAMP test. Using this dried multiplex LAMP test, the analytical sensitivity was determined to be 100 copies for each viral target and 100–1000 copies for the simultaneous detection of mixed targets. The multiplex LAMP system was validated using clinical COVID-19 specimens and compared with the real-time qRT-PCR method as a reference test. The determined sensitivity of the multiplex LAMP system for SARS-CoV-2 was 71% (95% CI: 0.62–0.79) for cycle threshold (Ct) ≤ 35 samples and 61% (95% CI: 0.53–0.69) for Ct ≤40 samples. The specificity was 99% (95%CI: 0.92–1.00) for Ct ≤35 samples and 100% (95%CI: 0.92–1.00) for the Ct ≤40 samples. The developed simple, rapid, low-cost, and laboratory-free multiplex LAMP system for the two major important respiratory viral diseases, COVID-19 and influenza, is a promising field-deployable diagnosis tool for the possible future ‘twindemic, ‘ especially in resource-limited settings.

Introduction

Since the emergence and rapid global spread of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) in early 2020, coronavirus disease 2019 (COVID-19) continues to pose a serious threat to public health and negatively affect the global economy. Early diagnosis is critical for appropriate patient care and the prevention of disease spread. In most reference laboratories, the diagnosis of COVID-19 is confirmed by detecting SARS-CoV-2 RNA using real-time reverse transcription-PCR (qRT-PCR), which is considered the gold-standard method due to its high sensitivity and specificity. However, obtaining results often requires a few hours and well-equipped laboratories. Moreover, the costs of the equipment and reagents are high. As such, rapid diagnostic tests (RDTs) are frequently used, especially when a rapid result is required, such as in arrival testing at airports, or areas with limited laboratory access. The disadvantages of RDTs are lower sensitivity and specificity compared to qRT-PCR method, although variable performance has been reported [1].

Several novel diagnostic approaches have been developed for the detection of SARS-CoV-2 nucleic acids [2]. Among these, reverse transcription loop-mediated isothermal amplification (RT-LAMP) is a promising alternative rapid diagnostic tool with high sensitivity, specificity, speed, and simplicity [3]. Reverse transcription and amplification can be performed at a constant temperature for less than one hour. Regarding detection, LAMP amplification can be judged by changes in turbidity, fluorescence, or color by the naked eye. The simplicity of LAMP allows point-of-care testing, resulting in its wide application for the diagnosis of infectious diseases [4]. RT-LAMP methods for detecting SARS-CoV-2 are now commercially available, demonstrating moderate to excellent agreement with the gold-standard qRT-PCR [5, 6]. However, conventional RT-LAMP tests generally only detect a single pathogen; therefore, multiple reactions are required for the concurrent detection of more than two target pathogens. A multiplex LAMP assay that detects SARS-CoV-2 and influenza virus simultaneously has been reported [6], which utilized the Detection of Amplification by Releasing of Quenching (DARQ) method. DARQ uses a 5’-quencher-added FIP annealed to the 3’- fluorophore Fd, which is complementary to FIP. Following LAMP amplification, the primers detach and release Fd, which emits the fluorescence [7]. Although the system is robust and has great potential for the simultaneous detection of multiple pathogens, it still requires a fluorescence detector to obtain results, making it impractical for resource-limited laboratories.

DNA chromatography in a lateral flow (dipstick) format is originally established for the post-multiplex PCR visualization tool [8]. Recently, one of the simple formats of DNA chromatography “C-PAS,” developed by the Japanese company TBA, was applied for the visualization after multiplex LAMP amplification of Sarcosystis spp. and Shiga toxin-producing Escherichia coli from game meats [9], and Plasmodium spp. and Rickettsia spp. from human blood [10]. In this study, we developed a multiplex-LAMP assay combined with DNA chromatography to detect SARS-CoV-2, influenza A virus (IAV), and influenza B virus (IBV) simultaneously as a tool for rapid on-site diagnosis. We designed novel primer sets for detecting SARS-CoV-2 and optimized a multiplexing condition with the reported LAMP primer sets for detecting the influenza virus. This generic multiplex-LAMP assay is easy to perform, does not require expensive equipment, and is rapid. Thus, it has great potential as a point-of-care test for the simultaneous detection of COVID-19 and influenza.

Materials and methods

Viral RNA and in vitro transcribed RNA template

SARS-CoV-2 RNA was extracted from viral isolate (JPN/TY/WK-521 strain, Pango lineage: A, GISAID ID: EPI_ISL_408667) using Direct-zol RNA kits (Zymo research, Orange, CA). The virus was kindly provided by the National Institute of Infectious Diseases in Tokyo, Japan, and was propagated as previously described [11]. Influenza virus RNA was extracted from influenza A virus strains, A/Hokkaido/32/2011 (H1N1), and an influenza B virus strain, B/Hokkaido/2/2016 (Victoria lineage), respectively. To obtain the RNA of LAMP target regions, in vitro transcription RNA templates for SARS-CoV-2, IAV, and IBV were prepared by using in vitro transcription T7 kit (Takara, Shiga, Japan). The target regions were amplified with LAMP F3 and B3 primer for each virus (Table1) using QIAGEN OneStep RT-PCR Kit (Qiagen, Valencia, CA). The amplicons were cloned into a pGEMT-easy vector (Promega, Maddison, WI). In vitro transcribed RNA was treated by DNase, and purified by a Nucleospin RNA clean-up kit (Takara). The RNA concentration was measured by Qubit RNA HS kit and Qubit fluorometer (ThermoFisher, Waltham, MA), and copy numbers were calculated.

COVID-19 clinical specimens and influenza virus specimens

RNA was extracted from nasopharyngeal swabs which were collected in St. Vincent’s university hospital and Master Misericordiae University Hospital, Dublin, Ireland, in 2019 using the QIAamp Viral RNA Mini Kit (Qiagen) and used for the COVID-19 test. All specimens were originally collected after written informed consent had been obtained for the infectious diseases cohort project. In this study, we did not obtain any patient-related data, and only converted IDs were used. The use of the RNA sample secondarily for the validation of our study was approved by the St. Vincent’s University Hospital Ethics & Medical Research Committee and Master Misericordiae University Hospital (1/378/1397), and the Institutional Research Committee of Hokkaido University (jinjuu 2020–11).

A nasopharyngeal swab specimen was obtained from a healthy individual and was used to make pseudo-specimen spiked with influenza viruses. The RNA extracted from the original swab sample was all negative for IAV, IBV, and SARS-CoV-2 by qRT-PCR as described below. The viral titers were determined as plaque-forming units (PFU) using MDCK cells. A 140 μL of the nasal swab sample was pulsed with the known titers of IAV and IBV, and the 40 μL of RNA was extracted using QIAamp Viral RNA Mini kit (Qiagen).

Primer for the reverse transcription-LAMP assay for SARS-CoV-2 and influenza viruses

Primers for detecting SARS-CoV-2 were designed using Primer Explorer V5 software (Eiken Chemical, Tokyo, Japan) targeting the nucleocapsid region of SARS-CoV-2. Out of the ten candidate primer sets of FIP/BIP/F3/B3, the best primer set was chosen which showed the fastest amplification time using a serially diluted SARS-CoV-2 DNA template. For the best candidate primer sets (S1 Table: primer candidate 1), LF and LB primers were further designed using Primer3 [12]. For the initial primer screening, the DNA template of the genome position at 28276–28975 (reference strain 2019-nCoV WHU01) was synthesized (Eurofins Genomics, Tokyo, Japan), and used as the LAMP reaction template. For influenza virus detection, we utilized already established primer sets [13, 14] with a modification in that we used primer sets without a quenching primer (QP). The primers were purchased from Thermo Fisher scientific unless specified.

Reverse transcription-LAMP assay targeting a single target

Reverse transcription-LAMP assay as a single liquid format was performed as described [15]. Each 25 μl RT-LAMP reaction mix consisted of 3.75 U WarmStart RTx reverse transcriptase (New England Biolabs Inc., Ipswich MA), 4 U RNase inhibitor (Takara), 8 U Bst 2.0 WarmStart DNA polymerase (New England Biolabs Inc.), deoxyribonucleotide triphosphate at 1.4 mM each (dNTPs; Nippon Gene, Tokyo, Japan), 20 mM Tris-HCl pH10.0, 50 mM KCl, 6 mM MgSO4, 10 mM (NH4)2SO4, 160 mM Trehalose (Fujifilm Wako, Osaka, Japan) LAMP primer sets (FIP and BIP; 1.6 μM, F3 and B3; 0.2 μM, LF and LB; 0.8 μM), 120 μM colori-fluorometric indicator (CFI; 3 mM phydroxyl-naphtol blue; MP Biomedicals, Autora, OH, and 0.35% v/v GelGreen; 10,000x solution in DMSO, Biotium, Hayward, CA), 160 mM Trehalose (FUJIFILM Wako Pure Chemical, Osaka, Japan), 0.1% Triton X-100 containing DDW, and 2 μl of template RNA. FIP contained the sequence tag (F1, F3, F4) at the 5’ end, followed by the C3 spacer oligonucleotide modification before the F3 sequences for the DNA chromatography (Tohoku Bio Array: TBA, Sendai, Japan) hybridization. B3 primers had biotin modification at 5’ ends for the visualization on DNA chromatography by streptavidin beads. LAMP primer sets are listed in Table 1. For the RT-LAMP condition setup purpose, the LAMP amplification reaction at 65°C was monitored using the real-time machine FAM channel (CFX-96/ Bio-Rad, Harcules, CA), detecting fluorescence of GelGreen reagent. One cycle of the amplification was set as 1 minute; thus, the reaction time speed (min) was estimated to be equal to the Ct value. Melting curve analysis was performed following each LAMP reaction, and melting temperature (Tm) was obtained to confirm the target-specific amplification.

Realtime qRT-PCR detecting SARS-CoV-2 and influenza viruses as the reference tests

For the detection of the SARS-CoV-2 to compare with the RT-LAMP result, ‘N set no. 2 (N2)’ primers and TaqMan MGB probes designed by the National Institute of Infectious Diseases, Japan (NIID) were used as described before [16] with a slight modification of the reaction scale. The one-step real-time quantitative RT-PCR reaction mix consisted of 10.0 μl of QuantiTect Probe RT-PCR Master Mix (Qiagen), 1.0 μl of 10μM forward primer (final 500 nM), 1.4 μl of 10 μM reverse primer (700 nM), 0.8 μl of 10 μM TaqMan Probe (200 nM), 1.6 μl RNase-free water, and 2 μl of the RNA template. The RT step was performed at 50°C for 30 min, followed by incubation at 95°C for 15 min. The PCR step included 45 cycles of denaturation at 95°C for 15 sec, followed by annealing and extension at 60°C for 30 sec. The real-time amplification data were acquired and analyzed using ABI 7500 Fast real time PCR platform (Thermo Fisher Scientific). For the detection of influenza A and influenza B, 500 nM InfA-Fwd:5’-AAGACCAATCCTGTCACCTCTGA-3’, 500 nM InfA-Rev: 5’-CAAAGCGTCTACGCTGCAGTCC-3’, 250 nM InfA-Probe: 5’-FAM-TTTGTGTTCACGCTCACCGTGCC-BHQ-3’ and 500 nM InfB-Fwd: 5’-GAGACACAATTGCCTACCTGCTT-3’, 500 nM InfB-Rev: 5’-TTCTTTCCCACCGAACCAAC-3’, 250 nM InfB-Probe: 5’-FAM-AGAAGATGGAGAAGGCAAAGCAGAACTAGC-BHQ-3’ were used [17]. The amplification condition was the same as above.

Multiplex reverse transcription-LAMP assay and the visualization of LAMP product by dipstick DNA chromatography

The multiplex RT-LAMP was performed in the same condition with a single RT-LAMP reaction as described above, except that three sets of primers listed in Table1 were all mixed, and primer concentration was optimized as described later. The DNA chromatography (C-PAS), blue-colored latex bead with streptavidin, and 300 mM NaCl C-PAS buffer ver2 were purchased from Tohoku bioarray (TBA). On the C-PAS strip, four tags cF1-4 were immobilized, which are the complementary sequences to the F1-F4 tag sequences of the primer. In this study, IAV, IBV, and SARS-CoV-2 LAMP amplified products are designed to bind to c-F1, c-F3, and c-F4 lines, respectively. One microliter of multiplex LAMP product, 17 μl of the C-PAS buffer ver2, and 2 μl of the latex beads were mixed (final 300 mM NaCl) in a 1.5ml tube or 96 deep-well plate, the DNA chromatography was inserted into the tube, and the result was confirmed after 10 minutes incubation by the naked eye. The condition of the C-PAS buffer was applied from the previously reported study [18].

Making dried format multiplex reverse transcription-LAMP assay

The drying procedure of LAMP reagents was performed by our previously reported in-house protocol using trehalose [15] with slight modification for the concentration of RNase inhibitor for better prevention of the RNA degradation. The dried format multiplex RT-LAMP reagent consisted of two parts: enzymes and dNTPs on the tube lid and primers and detection dye on the bottom. This is because mixing all the reagents failed to keep enzyme activity in our attempt [15], possibly explained as making an amorphous phase for the enzyme vitrification is highly dependent on the successful dehydration [19, 20]. Three sets of primers listed in Table 1 (each 0.1 μl of 100 mM FIP with tag sequence and biotinylated BIP; 0.1 μl FIP and BIP without modification, 0.025 μl of 100 mM F3 and B3, 0.1 μl LF and LB), 1 μl of 3 mM CFI are dried with 0.7 μl of 2 M trehalose are prepared on the bottom of the 0.2 ml PCR tube. For the tube lid, 1.4 μl of 25 mM dNTPs, 0.05 μl of a high-concentration Bst-polymerase (120 U/μl; NEB), 0.25 μl of a normal concentration Bst-polymerase (8 U/μl), 0.3 μl of RNase inhibitor (40 U/μl; Takara Bio Inc., Shiga, Japan), 0.25 μl of WarmStart RTx reverse transcriptase (15 U/μl; NEB), and 1.6 μl of 2 M Trehalose was mixed, and placed inside of the tube lid. For aliquoting these reagents to the tube bottom and tube lid, an automatic pipette (E1-ClipTip; Thermo Fisher Scientific) was used to minimize liquid handling errors. The tube was air-dried with an ultra-low dew point air dryer (QD20-50; IAC Co., Kawasaki, Japan) for 12 hours. The dried LAMP reagent tube is kept with silica gel at ambient temperature for one week. Reaction buffer 23 μl, consisting of 20 mM Tris-HCl (pH10.0), 50 mM KCl, 6 mM MgSO4, 10 mM (NH4)2SO4 in TritonX-100, and 2 μl of template was added before the reaction.

Results

The sensitivity of newly designed RT-LAMP assays detecting SARS-CoV-2 RNA

The primer set for detecting SARS-CoV-2 was selected from ten candidate primer sets using synthetic DNA as a template, which showed the fastest amplification without non-specific amplification in the no-template control (NTC) (S1 Table and Table 1). Additionally, emerging nucleotide mutations in the SARS-CoV-2 genome that may affect the binding efficacy of LAMP primer sets were determined using the online COVID-19 CG tool [21] (https://covidcg.org/). Data from 11,207,833 sequences deposited in the GISAID from Dec 2019 to Jan 2023 were used. The confirmed nucleotide mutation in the primer region was relatively low, at highest 0.025%, suggesting that the designed LAMP primer sets using the original outbreak strain is still applicable to the current variant strains (S2 Table).

Using the selected primer candidate, up to 1000 copies of DNA templates were amplified in 100% sensitivity (3/3; 95% CI: 0.29–1.00) for an amplification time of 18.2 ± 1.4 min (Fig 1A). 100 copies were also amplified in 66.6% (2/3; 95% CI: 0.09–0.99) for an amplification time of 25.4 ± 4.3 min. To further evaluate the analytical sensitivity, serially diluted RNA extracted from SARS-CoV-2 cultured viruses was assayed for RT-LAMP analysis. The same RNA was used for the real-time qRT-PCR assay (NIID-N2) as a reference test. The fluorescence signal generated from LAMP amplification was observed for an amplification time of 23.5 ± 1.6 min, detecting up to a 1000 times dilution point of the RNA (3/3; 95%CI: 0.29–1.00). This corresponds to the cycle Ct value of 34.2 in the reference real-time qRT-PCR, which was estimated to be 211 copies per reaction using the standard in vitro transcribed RNA as the standard (Fig 1B).

thumbnail
Fig 1. Evaluation of the sensitivity of the newly designed RT-LAMP assay in detecting SARS-CoV-2.

(A) Amplification curves for the novel RT-LAMP assay using serially diluted plasmid DNA as a template. A conventional liquid format with a single primer set for detecting SARS-CoV-2 was used in the assay. Three independent experiments were performed. The mean ± SD value of the reaction Ct is shown as the positivity time (min). ND: not detected. (B) Amplification curves of the RT-LAMP assay using serially diluted viral RNA as a template. RNA extracted from the strain JPN/TY/WK-521 (Pango lineage A) was used. The same RNA was assayed for the reference qRT-PCR, and the mean cycle threshold (Ct) value of real-time RT-PCR assay and estimated copy number of the viral genome are shown.

https://doi.org/10.1371/journal.pone.0285861.g001

Optimization of multiplex RT-LAMP condition detecting for SARS-CoV-2, influenza A, and influenza B viruses, and visualization on DNA chromatography

To achieve multiplex RT-LAMP amplification and visual detection of SARS-CoV-2, IAV, and IBV; DNA chromatography C-PAS was utilized. The FIP primer for each target had a unique sequence oligonucleotide tag, and BIP had a biotin modification at the 5’-end. This enabled hybridization to the DNA chromatography, in which complement oligonucleotides were immobilized, and the streptavidin buffer generated a clear visible blue band on the strip (Fig 2).

thumbnail
Fig 2. Schematic illustration of multiplex RT-LAMP and visualization using dipstick DNA chromatography.

Step 1: Primers targeting SARS-CoV-2, IAV, and IBV are tagged with sequence Tags and biotin (“hot”) primers are mixed with non-modified primers (“cold”) primers in three different conditions. Step 2: After LAMP amplification, the product is visualized using DNA chromatography. C-F1, c-F3, and c-F4: complementary oligonucleotides for each tag. The blue lines represent the positive reactions, whereas the two red lines are the originally printed position markers.

https://doi.org/10.1371/journal.pone.0285861.g002

Next, we mixed three sets of primers detecting SARS-CoV-2, IAV, and IBV (a total of 20 primers are shown in Table 1) to make a multiplex RT-LAMP system. In this optimization experiment, the synthesized RNAs were used as templates at a concentration of 1000 copies per reaction. Amplification was monitored by fluorescence using a real-time PCR machine, and visualized using DNA chromatography after 60 min of amplification. First, the primer amount of the single LAMP amplification for three targets was all mixed, in which FIPs were tag sequence-labeled, and BIPs were biotin-labeled (100% hot primer condition; primer concentration are shown in Fig 2). Following multiplex LAMP reaction and DNA chromatography visualization, a colored band was observed for the two target templates (Fig 3A; 2–4). However, a line corresponding to SARS-CoV-2 amplification was not observed when the three targets were used as templates (Fig 3A: 1). This negative result on DNA chromatography in the simultaneous detection of the three targets was possibly due to poor SARS-CoV-2 amplification under multiplexing conditions, or poor amplicon-chromatography hybridization due to interference of multiple amplicons. The latter is more likely as the amplified products from three single targets showed a positive result for each target and resulted in negativity for the SARS-CoV-2 position when mixed and visualized using DNA chromatography. Thus, the condition of the half amounts of primers for modified (“hot”) primers and the remaining half for without tag-sequence and biotin (“cold”) primers was tried (50% hot/ 50% cold), resulting in a similar result (Fig 3A; 5–8). However, a faster amplification speed was observed when compared with the primer condition without cold primers (Fig 3B; 100% hot vs. 50% cold/ 50% hot); thus, we hypothesized that tag sequences with spacer C3 in FIP primers may limit the amplification efficacy of the RT-LAMP reaction. Then, the 25% cold/ 25% hot condition was tested, in which FIP/BIP primers without tag-sequence and biotin (cold primer) were mixed with the hot primers at a concentration ratio of 1:1 while the primer amount for each target was kept as half. This primer condition provided a balanced result for detecting all three targets on the chromatography (Fig 3A; 9–12) and was chosen as the primer condition for our multiplex RT-LAMP system.

thumbnail
Fig 3. Optimization of the primer condition for multiplex RT-LAMP assay detecting SARS-CoV-2, IAV, and IBV.

(A) DNA chromatography results visualizing multiplex RT-LAMP products. 1000 copies of SARS-CoV2, IAV, and IBV RNA templates were mixed, and used for testing the simultaneous amplification capacity. Three different primer conditions were compared by mixing “hot” (with tag and biotin) and “cold” (plain) primers. Blue bands are the positive reactions. Arrowhead indicates the positive position for each LAMP product. The red lines are the position marker. The experiment was performed three times, and a representative of the same result is shown. (B) The amplification curve and the positivity time of the RT-LAMP in three different primer conditions detecting a single RNA template. The mean ± SD value of the reaction Ct is shown as the positivity time (min).

https://doi.org/10.1371/journal.pone.0285861.g003

The analytical sensitivity and specificity of the air-dried multiplex RT-LAMP in detecting SARS-CoV-2, IAV, and IBV simultaneously

Under liquid-format RT-LAMP conditions, the reagent preparation procedure is laborious, which contains 26 primers and 9 reagents that require strict cold temperature storage monitoring. Thus, to minimize the procedure and for the convenience of the transport and storage, we applied our previously developed air-drying technique to the multiplex RT-LAMP system using trehalose as a preserving molecule. A mixture of primers and reagents was air-dried at room temperature in a PCR tube. The dried tubes were tested after a week to validate the analytical sensitivity of the multiplex RT-LAMP assay. To test the analytical sensitivity of the multiplex RT-LAMP assay for detecting three targets, SARS-CoV-2, IAV, and IBV, 10-fold serially diluted RNA templates containing 105–1 copies per reaction were prepared and assayed using the multiplex RT-LAMP assay under the primer conditions described above. At a dilution of 100 copies, three out of three replicates of IBV and SARS-CoV-2 were positive both in fluorescence and C-PAS (100% sensitivity; 95% CI: 0.29–1.00). while two out of two were positive for IAV (66.6% sensitivity; 95% CI: 0.09–0.99: Fig 4 and Table 2). The observed sensitivity of 100 copies of RNA was similar to that obtained by real-time PCR estimation of SARS-CoV-2 viral RNA (up to 211 copies in Fig 1B). The sensitivity of the single RT-LAMP assay for IAV and IBV also agreed with the analytical sensitivity of 25–250 copies/reaction reported for the same primer sets [13]. However, when multiple targets were amplified together in the multiple RT-LAMP system, a 10–100 fold less sensitivity was observed (Fig 4 and Table 2), which may be explained by the competition of the enzymes and interference of the reactions.

thumbnail
Fig 4. Analytical sensitivity of dried multiplex-LAMP and DNA chromatography detecting SARS-CoV-2, IAV, and IBV.

Representative result of DNA chromatography visualizing dried multiplex-LAMP products from three independent experiments. A single or combination of SARS-CoV2, IAV, and IBV RNA was used as the multiplex RT-LAMP assay template. The remaining results with amplification times are summarized in Table 2. The blue bands represent a positive reaction and the arrowhead indicates a positive position for each LAMP product. The red line is the position marker.

https://doi.org/10.1371/journal.pone.0285861.g004

thumbnail
Table 2. The sensitivity of the multiplex LAMP system using the DNA chromatography, and the positivity time in fluorescence.

https://doi.org/10.1371/journal.pone.0285861.t002

In all NTC experiments (n = 21, Table 2) within an amplification time 60 min, none of them showed a non-specific reaction in fluorescence and DNA chromatography, thus the determined specificity of the multiple RT-LAMP system under this condition was 100% (0/21; 95% CI: 0–0.16). The specificity of the positive reactions was also confirmed by the Tm values after amplification, where positive samples from IAV, IBV, and SARS-CoV-2 showed Tm values of 87.5, 86.5, and 86.5, respectively (S1A Fig). When the reaction time was extended to 150 min, three out of 24 reactions were positive for NTC, which was assumed to be non-specific amplification or primer dimer formation. Non-specific amplifications were observed after 93.5 minutes, with sufficient time remaining from the decided LAMP reaction endpoint of 60 min (S1B Fig). The chromatography results of these three non-specific amplifications were inconsistent; one showed a double band on the IAV, SARS-CoV-2 line, and the other two showed no band on chromatography (S1C Fig), which could be explained by the different combinations of primer-dimers in each non-specific amplification.

Evaluation of multiplex RT-LAMP using pseudo-clinical samples pulsed with influenza virus.

To determine the sensitivity and specificity of IAV and IBV detection, pseudo-clinical specimens were prepared by mixing known titers of IAV and IBV into nasopharyngeal swab samples. IAV and IBV virus supernatants were added to the swab sample to obtain the highest concentration of 1.43 × 105 PFU/ml, which is equivalent to 1000 PFU in 2 μl of template RNA, assuming the RNA extraction recovery rate was 100%. A ten-fold dilution of the virus was prepared, and the RNA extracted from these pseudo-clinical influenza samples was used for the dried format multiplex RT-LAMP system. qRT-PCR was also performed as a reference test. As a result, in both IAV and IBV, 100 PFU equivalent samples were amplified in three out of three independent experiments (Table 3, 100% sensitivity; 95% CI: 0.29–1.00). In IBV, 10 PFU equivalent samples were also amplified in two out of three experiments (Table 3, 66.6% sensitivity; 95% CI: 0.09–0.99).

thumbnail
Table 3. Result of dried format multiplex LAMP using RNA extracted from nasopharyngeal samples pulsed with influenza virus.

https://doi.org/10.1371/journal.pone.0285861.t003

Evaluation of multiplex RT-LAMP using COVID-19 clinical specimens

The newly developed multiplex RT-LAMP system was evaluated using 192 RNA samples from nasopharyngeal swabs collected from patients with suspected COVID-19 in Ireland. RNA was tested using real-time qRT-PCR for SARS-CoV-2, IAV, and IBV as a reference test, and the same RNA was used to validate the multiplex RT-LAMP system in a dried format. All 192 samples tested negative for the influenza virus. The LAMP reaction was monitored using a real-time PCR machine for 60 min, and the positive turnaround time was plotted on the Y-axis, whereas the positive real-time qRT-PCR results were plotted as Ct values on the X-axis (Fig 5). All the multiplex RT-PCR amplified products were also tested for DNA chromatography C-PAS, and the positive results for COVID-19 agreed with the LAMP positivity results measured by fluorescence (S2 Fig). In the multiplex LAMP assay, a positive correlation was observed between the RT-LAMP reaction time and qRT-PCR Ct value, suggesting that the RT-LAMP reaction time is correlated with the original viral RNA amount, although LAMP amplification is not a strictly proportional event. A false-negative result in RT-LAMP was observed for the sample above Ct 27 (Fig 5), suggesting a lower detection power for samples with low viral RNA.

thumbnail
Fig 5. Reactivity of multiplex LAMP compared with reference qRT-PCR for detecting clinical COVID-19 suspected specimens.

(A) The scatter plot of the reaction time of dried format multiplex LAMP using clinical COVID-19 suspected specimens plotted against the Ct value of NIID-N2 reference qRT-PCR. The results of qPCR and LAMP were categorized and shown in different colors. Ct threshold values of 35 and 40 were used for sensitivity/specificity determination. A linear regression line with a shaded SE value is shown for the result group LAMP+/qPCR+ (Ct ≤ 35). (B) DNA chromatography results after multiplex LAMP assay.

https://doi.org/10.1371/journal.pone.0285861.g005

The determined sensitivity for dried format multiplex RT-LAMP assay using the clinical COVID-19 specimen was 61% (95% CI: 0.53–0.69), and specificity was 100% (95% CI: 0.92–1.00) when all positive results under a Ct value of 40 in qRT-PCR were considered as positive. Alternatively, when the Ct values of 35 were used as a cut-off value, the sensitivity and sensitivity were determined to be 71% (95% CI: 0.62–0.79) and 99% (95% CI: 0.92–1.00), indicating that moderate sensitivity and high specificity can be obtained for the higher viral RNA road specimen (Table 4).

thumbnail
Table 4. Result of dried format multiplex LAMP using clinical COVID-19 suspected specimens, and its agreement with the reference qPCR test.

https://doi.org/10.1371/journal.pone.0285861.t004

Discussion

Both COVID-19 and influenza cause respiratory illnesses with similar clinical manifestations; therefore, a differential diagnosis is difficult without laboratory confirmation. During the pandemic, the cases of influenza virus infection have decreased. This is possibly a result of strict interventions undertaken by most countries, such as physical distancing, travel restrictions, and staying home [22, 23]. In addition, clinical diagnosis often relies on a single laboratory test for COVID-19. This may have decreased the detection rate of influenza infections. However, seasonal and pandemic influenza viruses can cause concurrent COVID-19 epidemics. Co-infection with SARS-CoV-2, IAV, and IBV has also been reported [23] and their potential to worsen the clinical outcome of COVID-19 has been suspected [24, 25]. Therapeutic drugs for COVID-19 have recently been developed (WHO-2019-nCoV-therapeutics-2022.4-eng.pdf) and are now available, highlighting the increasing importance of specific diagnoses and treatments. Thus, to detect these two important respiratory viruses simultaneously in a field-deployable format, a multiplex LAMP assay that can detect SARS-CoV-2, IAV, and IVB was developed in this study.

In addition to the gold-standard real-time qRT-PCR and RDTs, many new methods for COVID-19 diagnosis have been developed. LAMP is one such method, and commercial products are available from several companies. However, these are mostly single-pathogen detecting methods. A recent study described a multiplex LAMP method or qRT-PCR to detect SARS-CoV-2 and influenza viruses simultaneously. This is achieved using multicolor fluorescence and/or differentiation using melting curve analysis. This technology still requires an initial cost for the fluorometer [6]. The advantage of our multiplex LAMP system is that the required equipment is minimal, making it suitable for use in resource-limited areas. In addition, the biggest challenge in the use of conventional LAMP is the requirement for a cold chain. To solve this problem, we utilized our in-house protocol for drying reagents with trehalose, which is ideal for LAMP in clinical settings [26]. We have previously shown that enzyme stability in this method can be guaranteed for up to six months, with a slight decrease in reaction time. The storage at 10°C prolonged its shelf-life [27].

Our results using 192 clinical specimens indicate that our developed multiplex RT-PCR has lower sensitivity and faster diagnostic performance for detecting SARS-CoV-2 than conventional RT-qPCR. Notably, a clear correlation was observed between the Ct value of RT-qPCR and the reaction time of our RT-LAMP assay, especially in the high viral-load samples with a lower Ct values. In the RT-LAMP assay, samples with Ct values < 27 were all detected. The Ct value alone cannot be compared to the viable viral load, but it has been argued that the culture positivity declines with increasing cycle threshold values, and above 35 cycles may not be contagious [28]. Although more data are required to determine the real threshold for each qRT-PCR test, it is important to consider the test accuracy by comparing the Ct values. Therefore, in this study, we calculated the sensitivity and specificity of qRT-LAMP test for each Ct threshold. In either criterion, our multiplex qRT-LAMP test showed moderate sensitivity with 61% (95% CI: 0.53–0.69) for the Ct<40 threshold and 71% (95% CI: 0.62–0.79) for the Ct<35 threshold. Importantly, the specificity was excellently high, except for one sample that was categorized as a false positive in LAMP when a qRT-PCR Ct<35 threshold was applied. This result suggests that our qRT-LAMP assay is useful for rapid and reliable diagnosis, particularly in primary healthcare settings.

This study has several limitations. First, we validated only purified RNA samples from suspected COVID patients. To be truly point-of-care testing, RNA extraction step should be omitted. In related research, several efforts have been made to improve the sensitivity and specificity of unprocessed samples. The prevention of endogenous RNase activity appears to be a key steps in preventing unreliable results. Boiling of the samples with reducing agents such as tris(2-carboxyethyl)phosphine (TCEP) to inactivate endogenous RNase, and simple glass milk purification from nasopharyngeal swab samples has been reported to show dramatically improved sensitivity and specificity [29]. Such a trial using crude sample is required for point-of-care testing in resource-limited places. In addition, as we only used COVID-19-positive specimens, a test of the clinical samples that are positive for influenza viruses, and/or coinfected with SARS-CoV-2 and influenza viruses is also required in the future. Another concern is the relatively low target detection sensitivity. The analytical sensitivity of the synthesized RNA was 100 copies for the IAV/IBV/SARS-CoV-2 single target, whereas it was 10 PFU and 100 PFU for the spiked IBV and IAV pseudo-specimens, respectively. This was obviously less sensitive than qRT-PCR methods [30, 31]; thus, further improvement in the primer design of the assay system is needed. The concern regarding the operational procedure to avoid the carry-over risk of amplicon contamination also needs to be addressed by creating a closed container system.

Conclusions

A multiplex LAMP assay combined with DNA chromatography was developed for COVID-19 and influenza. The total time from RNA to the results was less than 60 min. The result is easily visible without any equipment. Therefore, our multiplex LAMP assay may be a useful, time-saving, and field-deployable diagnostic method for these diseases. The multiplex LAMP assay developed in the present study can be applicable for various disease combinations.

Supporting information

S1 Table. The primer screening results for detecting SARS-CoV-2 nucleocapside region.

For an initial primer candidate screening, ten candidate primer sets were tested using synthesized DNA. The best performance primer set 1, which showed the fastest amplification without non-specific amplification was selected.

https://doi.org/10.1371/journal.pone.0285861.s001

(XLSX)

S2 Table. The observed mutation frequencies in the primer region.

The mutation data of 11,207,833 sequences from Dec 2019 to Jan 2023 was obtained from COVID-19 CG tool.

https://doi.org/10.1371/journal.pone.0285861.s002

(XLSX)

S1 Fig. Specificity of the multiplex LAMP assay and DNA chromatography.

(A) Melting curve analysis of the multiplex LAMP products after an extended reaction time of 150 min. The positive RNA control for IAV, IBV, and SARS-CoV-2 in 1000 copies, and n = 24 no template controls (NTCs) were tested. Three non-specific amplifications from the NTC showed different Tm values from the positive controls. (B) Amplification plots of n = 24 NTC samples. (C) Results of DNA chromatography in three non-specific amplifications.

https://doi.org/10.1371/journal.pone.0285861.s003

(TIF)

S2 Fig. DNA chromatography results after multiplex LAMP detecting clinical COVID-19 suspected specimens.

The chromatography results for 192 of COVID-19 suspected specimens after multiplex LAMP.

https://doi.org/10.1371/journal.pone.0285861.s004

(TIF)

References

  1. 1. Brümmer LE, Katzenschlager S, Gaeddert M, Erdmann C, Schmitz S, Bota M, et al. Accuracy of novel antigen rapid diagnostics for SARS-CoV-2: A living systematic review and meta-analysis. PLoS Med. 2021;18. pmid:34383750
  2. 2. Kevadiya BD, Machhi J, Herskovitz J, Oleynikov MD, Blomberg WR, Bajwa N, et al. Diagnostics for SARS-CoV-2 infections. Nat Mater. 2021;20: 593–605. pmid:33589798
  3. 3. Notomi T, Okayama H, Masubuchi H, Yonekawa T, Watanabe K, Amino N, et al. Loop-mediated isothermal amplification of DNA. Nucleic Acids Res. 2000;28: E63. pmid:10871386
  4. 4. Mori Y, Notomi T. Loop-mediated isothermal amplification (LAMP): Expansion of its practical application as a tool to achieve universal health coverage. J Infect Chemother. 2020;26: 13–17. pmid:31519395
  5. 5. Kitajima H, Tamura Y, Yoshida H, Kinoshita H, Katsuta H, Matsui C, et al. Clinical COVID-19 diagnostic methods: Comparison of reverse transcription loop-mediated isothermal amplification (RT-LAMP) and quantitative RT-PCR (qRT-PCR). J Clin Virol. 2021;139. pmid:33848785
  6. 6. Zhang Y, Tanner NA. Development of multiplexed reverse-transcription loop-mediated isothermal amplification for detection of SARS-CoV-2 and influenza viral RNA. Biotechniques. 2021;70: 167–174. pmid:33535813
  7. 7. Tanner NA, Zhang Y, Evans TC. Simultaneous multiple target detection in real-time loop-mediated isothermal amplification. Biotechniques. 2012;53: 81–89. pmid:23030060
  8. 8. Tian L, Sato T, Niwa K, Kawase M, Tanner ACR, Takahashi N. Rapid and sensitive PCR-dipstick DNA chromatography for multiplex analysis of the oral microbiota. Biomed Res Int. 2014;2014. pmid:25485279
  9. 9. Sugita-Konishi Y, Kobayashi N, Takasaki K, Kanno T, Itoh M, Riztyan , et al. Detection of Sarcocystis spp. and Shiga toxin-producing Escherichia coli in Japanese sika deer meat using a loop-mediated isothermal amplification-lateral flow strip. J Vet Med Sci. 2019;81: 586–592. pmid:30814421
  10. 10. Namangala B, Hachaambwa L, Kajino K, Mweene AS, Hayashida K, Simuunza M, et al. The use of Loop-mediated Isothermal Amplification (LAMP) to detect the re-emerging Human African Trypanosomiasis (HAT) in the Luangwa and Zambezi valleys. Parasit Vectors. 2012;5: 282. pmid:23211002
  11. 11. Sasaki M, Uemura K, Sato A, Toba S, Sanaki T, Maenaka K, et al. SARS-CoV-2 variants with mutations at the S1/S2 cleavage site are generated in vitro during propagation in TMPRSS2-deficient cells. PLoS Pathog. 2021;17. pmid:33476327
  12. 12. Untergasser A, Cutcutache I, Koressaar T, Ye J, Faircloth BC, Remm M, et al. Primer3—new capabilities and interfaces. Nucleic Acids Res. 2012;40: e115. pmid:22730293
  13. 13. Takayama I, Nakauchi M, Takahashi H, Oba K, Semba S, Kaida A, et al. Development of real-time fluorescent reverse transcription loop-mediated isothermal amplification assay with quenching primer for influenza virus and respiratory syncytial virus. J Virol Methods. 2019;267: 53–58. pmid:30831121
  14. 14. Nakauchi M, Yoshikawa T, Nakai H, Sugata K, Yoshikawa A, Asano Y, et al. Evaluation of reverse transcription loop-mediated isothermal amplification assays for rapid diagnosis of pandemic influenza A/H1N1 2009 virus. J Med Virol. 2011;83: 10–15. pmid:21108334
  15. 15. Hayashida K, Orba Y, Sequeira PC, Sugimoto C, Hall WW, Eshita Y, et al. Field diagnosis and genotyping of chikungunya virus using a dried reverse transcription loop-mediated isothermal amplification (LAMP) assay and MinION sequencing. PLoS Negl Trop Dis. 2019;13. pmid:31158221
  16. 16. Shirato K, Nao N, Katano H, Takayama I, Saito S, Kato F, et al. Development of Genetic Diagnostic Methods for Detection for Novel Coronavirus 2019(nCoV-2019) in Japan. Jpn J Infect Dis. 2020;73: 304–307. pmid:32074516
  17. 17. Van Der Vries E, Anber J, Van Der Linden A, Wu Y, Maaskant J, Stadhouders R, et al. Molecular assays for quantitative and qualitative detection of influenza virus and oseltamivir resistance mutations. J Mol Diagn. 2013;15: 347–354. pmid:23597879
  18. 18. Moonga LC, Hayashida K, Kawai N, Nakao R, Sugimoto C, Namangala B, et al. Development of a Multiplex Loop-Mediated Isothermal Amplification (LAMP) Method for Simultaneous Detection of Spotted Fever Group Rickettsiae and Malaria Parasites by Dipstick DNA Chromatography. Diagnostics (Basel, Switzerland). 2020;10. pmid:33147773
  19. 19. Willart JF, De Gusseme † A, Hemon S, Descamps M, Leveiller F, Rameau A. Vitrification and Polymorphism of Trehalose Induced by Dehydration of Trehalose Dihydrate. 2002 [cited 27 Jul 2020]. doi:10.1021/jp012836
  20. 20. Malferrari M, Savitsky A, Lubitz W, Möbius K, Venturoli G. Protein Immobilization Capabilities of Sucrose and Trehalose Glasses: The Effect of Protein/Sugar Concentration Unraveled by High-Field EPR. J Phys Chem Lett. 2016;7: 4871–4877. pmid:27934049
  21. 21. Chen AT, Altschuler K, Zhan SH, Chan YA, Deverman BE. COVID-19 CG enables SARS-CoV-2 mutation and lineage tracking by locations and dates of interest. Elife. 2021;10: 1–15. pmid:33620031
  22. 22. Groves HE, Piché-Renaud PP, Peci A, Farrar DS, Buckrell S, Bancej C, et al. The impact of the COVID-19 pandemic on influenza, respiratory syncytial virus, and other seasonal respiratory virus circulation in Canada: A population-based study. Lancet Reg Heal Am. 2021;1. pmid:34386788
  23. 23. Dadashi M, Khaleghnejad S, Abedi Elkhichi P, Goudarzi M, Goudarzi H, Taghavi A, et al. COVID-19 and Influenza Co-infection: A Systematic Review and Meta-Analysis. Front Med. 2021;8. pmid:34249971
  24. 24. Zheng J, Chen F, Wu K, Wang J, Li F, Huang S, et al. Clinical and virological impact of single and dual infections with influenza A (H1N1) and SARS-CoV-2 in adult inpatients. PLoS Negl Trop Dis. 2021;15. pmid:34843492
  25. 25. Swets MC, Russell CD, Harrison EM, Docherty AB, Lone N, Girvan M, et al. SARS-CoV-2 co-infection with influenza viruses, respiratory syncytial virus, or adenoviruses. Lancet (London, England). 2022;399: 1463–1464. pmid:35344735
  26. 26. Hayashida K, Kajino K, Hachaambwa L, Namangala B, Sugimoto C. Direct blood dry LAMP: a rapid, stable, and easy diagnostic tool for Human African Trypanosomiasis. Debrabant A, editor. PLoS Negl Trop Dis. 2015;9: e0003578. pmid:25769046
  27. 27. Hayashida K, Nambala P, Van Reet N, Büscher P, Kawai N, Mutengo MM, et al. Development of a bio-inkjet printed LAMP test kit for detecting human African trypanosomiasis. PLoS Negl Trop Dis. 2020;14: e0008753. pmid:33091922
  28. 28. La Scola B, Le Bideau M, Andreani J, Hoang VT, Grimaldier C, Colson P, et al. Viral RNA load as determined by cell culture as a management tool for discharge of SARS-CoV-2 patients from infectious disease wards. Eur J Clin Microbiol Infect Dis. 2020;39: 1059–1061. pmid:32342252
  29. 29. Anahtar MN, Mcgrath GEG, Rabe BA, Tanner NA, White BA, Lennerz JKM, et al. Clinical Assessment and Validation of a Rapid and Sensitive SARS-CoV-2 Test Using Reverse Transcription Loop-Mediated Isothermal Amplification Without the Need for RNA Extraction. Open forum Infect Dis. 2020;8. pmid:34853795
  30. 30. Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC, et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT-qPCR primer-probe sets. Nat Microbiol. 2020;5: 1299–1305. pmid:32651556
  31. 31. Rönkkö E, Ikonen N, Kontio M, Haanpää M, Kallio-Kokko H, Mannonen L, et al. Notes: Validation and Diagnostic Application of NS and HA Gene-Specific Real-Time Reverse Transcription-PCR Assays for Detection of 2009 Pandemic Influenza A (H1N1) Viruses in Clinical Specimens. J Clin Microbiol. 2011;49: 2009. pmid:21367994