Skip to main content
Download PDF
  • Methodology article
  • Open access
  • Published:

Two approaches for estimating the lower limit of quantitation (LLOQ) of microRNA levels assayed as exploratory biomarkers by RT-qPCR

BMC Biotechnology volume 18, Article number: 6 (2018) Cite this article

Abstract

Background

Circulating microRNAs are undergoing exploratory use as safety biomarkers in drug development. Reverse transcription quantitative polymerase chain reaction (RT-qPCR) is one common approach used to quantitate levels of microRNAs in samples that includes the use of a standard curve of calibrators fit to a regression model. Guidelines are needed for setting assay quantitation thresholds that are appropriate for this method and to biomarker pre-validation.

Results

In this report, we develop two workflows for determining a lower limit of quantitation (LLOQ) for RT-qPCR assays of microRNAs in exploratory studies. One workflow is based on an error threshold calculated by a logistic model of the calibration curve data. The second workflow is based on a threshold set by the sample blank, which is the no template control for RT-qPCR. The two workflows are used to set lower thresholds of reportable microRNA levels for an example dataset in which miR-208a levels in biofluids are quantitated in a cardiac injury model. LLOQ thresholds set by either workflow are effective in filtering out microRNA values with large uncertainty estimates.

Conclusions

Two workflows for LLOQ determinations are presented in this report that provide methods that are easy to implement in investigational studies of microRNA safety biomarkers and offer choices in levels of conservatism in setting lower limits of acceptable values that facilitate interpretation of results.

Background

MicroRNAs (miRNAs) that have restricted tissue expression and are released into biofluids upon tissue injury are being evaluated as safety biomarkers potentially diagnostic of site of injury. Tissue-selective miRNAs have been identified by profiling the miRNA content of bodily tissues in humans, mice, and rats [1,2,3]. Reverse transcription quantitative polymerase chain reaction (RT-qPCR) assays have been adapted for the detection of very low levels of miRNAs that are typically found in biofluids, especially in unaffected controls. For RT-qPCR reactions, the relative measure of the concentration of a miRNA target is the quantification cycle (Cq), the fractional cycle number at which a PCR amplification curve crosses a threshold line set within the exponential growth region of the amplification curve. If the amplification curve for an analyte never crosses the threshold line within 40–42 cycles of amplification, the analyte level is considered too low to be quantitated and the Cq is “undetermined.” Cq values are influenced by many factors, so they are not commutable values and cannot be directly compared between PCR reactions run under different conditions. Reporting of miRNA changes by relative quantitation of RT-qPCR data (normalizing Cq values to a control or reference sample Cq) is not an optimal approach because baseline levels of many candidate tissue-selective miRNAs are very low or undetectable in biofluids and because there is no consensus set of small RNAs in serum or plasma that can be widely used for normalization [4]. Although not widely used in the published literature, absolute quantitation of miRNAs in biofluids is a documented method [5] that has application for reporting results in the exploratory stages of biomarker development. A common approach for measurement of miRNA biomarker candidates by absolute quantitation is the use of RT-qPCR to assay standard curves of synthetic RNA calibrators in parallel to samples for interpolation of unknowns. Analytical validation guidelines recommend the use of at least 6 non-zero calibrators per calibration curve [6]. Calibration curves should cover the dynamic range of the assay, which is a minimum of three orders of magnitude for PCR and ideally five to six [7]. miRNA can also be quantified using droplet digital PCR, an alternate PCR-based approach that doesn’t rely on standard curves [8, 9] and is just beginning to be applied to miRNA safety biomarker assessments.

The Health and Environmental Sciences Institute (HESI) Technical Committee on the Application of Genomics to Mechanism-Based Risk Assessment initiated a multi-site study to assess current practice for absolute quantification of miRNAs in biofluids using RT-qPCR [10]. Several cardiomyocyte-enriched miRNAs were measured in biofluids from a rat model of drug-induced cardiotoxicity by RT-qPCR using primarily TaqMan™ reagents. A three parameter logistic model was used to fit data from serial dilutions of calibrators (see Fig. 1a) for the estimation of copy numbers and 95% confidence intervals (CIs) in experimental samples (see Fig. 1b). A three parameter logistic (3PL) fit was determined to be the best approach for fitting all the observed types of calibration curve data (linear and non-linear) in this study to a single model. In the study, no-template controls (NTCs), which were analyzed in parallel to calibrators and study samples through all RT-qPCR steps, often had background Cq values instead of the “undetermined” calls that are expected for blank samples. The background signal in the NTC samples was consistent with the detection of low levels of amplified non-target sequence artifacts generated by RT-qPCR, such as primer-dimers or primer concatemers. The background signal in the NTC proved difficult to eliminate because it appeared to be influenced by multiple factors such as preamplification, reaction multiplicity, and reagent lots.

Fig. 1
figure 1

Examples of graphs aiding LLOQ determinations based on logistic modeling. a 3-parameter logistic model fit of calibration curve data. b Inverse predictions with 95% confidence intervals for sample data

Full size image

During the exploratory stage of miRNA biomarker development, guidelines are needed for determining assay thresholds that are appropriate for this method and purpose since circulating levels of tissue-selective miRNA can be at very low to potentially zero baseline levels. The lower limit of quantitation (LLOQ) is the lowest amount of an analyte in a sample that can be quantitatively determined with suitable precision and accuracy. Bioanalytical method validation approaches recommended for pharmacokinetic studies are a good starting point for biomarker measurements but are not necessarily fully applicable [6]. For bioanalytical assays, the LLOQ is typically determined based on the reagent blank response (e.g., at least five times higher) and a threshold for acceptable precision [6]. For miRNA measurements, approaches have been used that define an LLOQ based on the noise around the NTC values, in combination with the slope or linear region of a calibration curve. Kelnar et al. have defined a PCR-specific LLOQ as the NTC Cq value minus a factor (10 times the standard deviation of the NTC replicates divided by the negative slope of the standard curve) [11]. Hindson et al. defined an LLOQ as the lowest concentration tested that remained above or equal to both the lower limit of the linear range and the limit of detection (LOD) [8]. The linear range was determined by runs-testing and the LOD by the mean NTC Cq plus 2.479 times the standard deviation of NTC Cq values. Hughes et al. defined an LLOQ as the lowest calibration curve point with a mean Cq value less than the mean NTC Cq that, if included, does not cause the calibration curve to fall outside a range of 90–110% for PCR efficiency [12]. A simple approach recommended for use with Exiqon miRCURY LNA Universal RT-qPCR assays for miRNA defines the assay background as 5 Cq units below the NTC Cq or below 42 if the NTC signal is undetected [13].

In response to a current lack of consensus methods for LLOQ determinations that can be used for absolute quantitation of miRNA by RT-qPCR in investigational studies, we evaluated several different methods that are relatively simple and intuitive, and based on principles established for bioanalytical assays. Workflows for each approach were developed using a test set of 65 miR-1 calibration curves that included 10–12 serial dilutions and covered four orders of magnitude at 3-fold intervals (see Additional files 1, 2, 3, 4). This diverse set of calibration curves was generated at six sites following standard protocols that included variations in the degree of multiplexing and incorporated differences in linearity, slope, and detection of background signals in NTC samples. LLOQ determinations were limited to measured points and were calculated on a per-run basis to match projected future workflows. The two workflows that were developed are described further below.

Results

LLOQ determination based on logistic modeling

A logistic model is useful for analyzing calibration data, as it finds a smooth underlying S-shaped curve to the data along with estimates of the noise around it. It furthermore enables inverse prediction, in which an x-value is determined from an observed y-value by reflecting off of the fitted curve. When using the logistic modeling approach for LLOQ determinations, it is advisable to construct and study various graphs in order to ensure the method is performing as intended as well as to discover any unusual data patterns and to tune threshold parameters. Figure 1 provides two such example graphs. Figure 1a plots a 3-parameter logistic fit to data for one of the runs; this is a case where the curve fits the data fairly well. Figure 1b is from the same data as 1a, and illustrates the degree of uncertainty inherent in model-based inverse prediction by means of arrows representing 95% confidence intervals on each inverse-predicted point. Inverse prediction makes LLOQ determination relatively straightforward after determining a suitable measure and threshold for error. We investigated two ways to do this. The first computes the percent relative error (δ) of inverse predictions (Cp) of known concentrations (Ck), using the following equation and a threshold of 20%.

$$ \delta =100\;\left|\frac{C_k-{C}_p}{C_k}\right| $$
(1)

The second option uses the model-based estimate of the standard error of the inverse prediction along with a threshold of 0.25. The standard error is computed using a first-order Taylor-series expansion of the inverse model eq. [14]. In both cases we look for two consecutive values that are below the threshold and choose the LLOQ to be the smallest observed concentration among all such pairs or set it to missing if no such value exists. The respective thresholds of 20% and 0.25 seem to be reasonable defaults and can be adjusted depending upon the desired application of the LLOQ values. If the logistic model does not fit the data well, e.g., in cases of poor data quality, the LLOQ will be indeterminate using the logistic model. Figure 2 depicts a workflow for the logistic model method with its two options.

Fig. 2
figure 2

Decision tree workflow for LLOQ determinations based on logistic modeling

Full size image

LLOQ determination based on baseline noise

Quantitation limits for analytical assays have also been based on signal-to-noise ratio [15]. A signal-to-noise ratio of 10 is a typical constant used to define the minimum concentration at which an analyte can be reliably quantified. We tested one approach that is based on defining an LLOQ as the nearest measured point that is ten-fold higher than the baseline noise level, with baseline noise being defined as the signal in the NTC sample in RT-qPCR assays. If there is no measurable background noise in the samples (i.e., Cq values for the NTC sample are assigned an “undetermined” call by the qPCR instrument software), the baseline signal could alternately be defined by the lowest detectable signal determined by the calibrators.

A workflow developed for LLOQ determinations based on baseline noise includes three decision nodes that cover the types of data found in the test set (Fig. 3). The first decision node asks if a Cq value is determined for the NTC. If yes, a factor of 10 (3.32 Cq units assuming a doubling of product per cycle) is subtracted from the mean NTC Cq to derive the NTC + 10. The concentration of the lowest measured point in the calibration curve with a mean Cq less than the NTC + 10 but higher in value than the Cq of the next higher calibrator is defined as the LLOQ. The second decision node asks if a mean Cq is “undetermined” for both the NTC sample and for at least one of the calibration curve dilutions. In that case, the highest calibration curve point with an “undetermined” Cq value is defined as the baseline noise level. The concentration of that point is multiplied by a factor of ten and the LLOQ is defined as the nearest measured point to this value. If the NTC Cq has an “undetermined” value but Cq values are assigned to all calibration curve points, the next lower dilution of the calibration curve (if it had been measured) is assumed to be the limit for signal-response measurements. For this situation, the concentration of the next dilution point in the series is multiplied by a factor of ten and the LLOQ is defined as the measured point nearest to this value. Examples of LLOQs determined using data that applies to the three decision nodes are given in Fig. 4. The baseline noise approach can be used to set thresholds for inverse predictions estimated from logistic modeling or log-linear regression of calibration curve data.

Fig. 3
figure 3

Decision tree workflow for LLOQ determinations based on baseline noise

Full size image
Fig. 4
figure 4

Examples of LLOQ determinations made using the baseline noise decision tree. The data is from the 3 replicates of miR-1 calibration curves run at one site on different days that covers the 3 options in the workflow. (a + b) Example of data that meets option 1: the NTC has a Cq value from which 3.32 is subtracted to derive a NTC + 10. The calibrator dilution with a Cq nearest the NTC + 10 is the LLOQ. (c + d) Example of data that meets option 2: the Cq for the lowest calibration curve point is undetermined. The lowest calibrator concentration is multiplied by 10 and the nearest calibrator concentration is the LLOQ. (e + f) Example of data using option 3. The concentration of the next unmeasured serial dilution point is calculated and multiplied by 10. The nearest measured calibrator concentration is the LLOQ. Black circles: calibration curve points. Red circles: NTC values. Red triangle: NTC + 10

Full size image

Comparison of LLOQ values determined using two workflows with a multi-site calibration curve dataset

Figure 5 illustrates the differences between the two workflows by plotting LLOQ values determined for the 65 miR-1 calibration curves in the test set. These values are also available in Additional file 5. The baseline noise workflow was the more conservative of two workflows. Most (92%) of the 65 LLOQs calculated by the baseline noise workflow were higher than the lowest calibrator concentration. Decision node 1 of the baseline noise workflow applied to the majority (69%) of the test set calibration curves that had Cq values were reported for the NTCs. For the logistic model-based approach, the lowest calibrator concentration was the same as the LLOQ for the majority of calculations using the relative error option (72%) or standard error option (54%) for this dataset. The two different options within the logistic model workflow produced the same result for 43 of the 65 calibration curves in the test set. When the results differed, the LLOQs determined by the standard error method were higher in magnitude for 21 of the 22 examples than the LLOQs determined by the relative error method, which was the least conservative of the approaches tested.

Fig. 5
figure 5

LLOQ determinations from two workflows for a multi-site set of miR-1 calibration curves. The lowest calibrator concentration in each standard curve (5.7 amol/L, 16.9 amol/L, or 50.8 amol/L) is indicated by the dashed line. LLOQs were calculated by the baseline noise workflow (O) or the logistic model workflow using the relative error option (+) or the standard error option (X). The calibration curve code conveys the presence of differences in site, assay multiplicity, and round among the dataset

Full size image

Application of LLOQ workflows for setting thresholds on miRNA values in an RT-qPCR absolute quantitation data set

The two LLOQ workflows were applied to a use case consisting of an independent inter-laboratory study described by Thompson et al. [10]. The dataset consists of 14 miRNA calibration curves and 104 unknowns generated at 5 sites by absolute quantitation of cardiac-enriched miR-208a-3p in plasma and urine samples from control and isoproterenol-treated rats. This dataset is suitable for comparing LLOQ workflows because baseline levels of miR-208a-3p in plasma have been observed to be near detection limits in several studies of its performance as a preclinical and clinical biomarker of cardiac injury [16, 17]. MiR-208a-3p was assayed in four biofluid samples on three separate days and quantitated from calibration curves run in parallel. Each calibration curve consisted of eight or ten 3-fold serial dilutions of a common stock of 2 pmol/L synthetic miR-208a-3p RNA, with the lowest dilution set at 0.3 fmol/L for 4 sites and at 0.03 fmol/L for one site (see Additional file 6). These lowest calibrator points are equivalent to 36.7 and 4.1 copies per μL biofluid, respectively. A 3-parameter logistic model was used to estimate copy numbers of miR-208a per μL and 95% CIs (Fig. 6a). Both of the LLOQ workflows used the calibration curve data and/or NTC values from the study to determine an LLOQ for each run. The LLOQs were used to set a lower threshold for miR-208a levels predicted from each run. miR-208a-3p values that were below the LLOQs determined using the logistic model with the standard error option or the baseline noise approach are graphed below the y-axis in Fig. 6b and c, respectively. The results for the relative error option were identical to the standard error option for this dataset and are not shown. Many of the miR-208a-3p measurements in control plasma or in urine were determined to be below LLOQs determined by either approach. For this dataset, nearly all (13/14) of the LLOQs determined using the standard error option, all 14 of the LLOQs determined using the relative error option, and 5/14 of the LLOQ determined using the baseline noise workflow were the same as the lowest calibrator concentration (see Additional file 7). Within the logistic model workflow, the standard error option appeared to be more conservative than the relative error option for this dataset using the aforementioned 0.25 and 20% thresholds, respectively.

Fig. 6
figure 6

Inverse predictions from 5 sites for miR-208a-3p levels with 95% confidence intervals in biofluids from pooled control (open circles) and 24 h isoproterenol (closed circles) treatment groups. In (a), no LLOQ threshold was applied. In (b), LLOQ thresholds were applied based on logistic model standard error and on baseline noise in (c). In total, 50/104 measurements were above the LLOQ for the baseline noise model and 52/104 for both of the logistic models. The methods agree on the common 50 and the two logistic methods are in exact agreement.

Full size image

Discussion

As part of a study on inter-laboratory variance in the absolute quantitation of miRNAs in biofluids using RT-qPCR, it became evident that there was a lack of clarity on how to establish a LLOQ for this type of data. It is useful to identify approaches that can be retrospectively applied to the types of datasets that were generated for this multi-site study. For example, in the standard protocol for the multi-site study, technical replicates were run at the PCR step but not at the RT step. LLOQ approaches that are based on error around the NTC Cq values would not be applicable to these datasets because both RT and PCR steps need to be included in the error estimate. The two workflows described in this report were developed using principles established for bioanalytical assays. The approaches are based on the logistic modelling of calibration curve data or the NTC Cq values for LLOQ determinations. When applied to a large dataset of calibration curves that were designed to exceed the linear range of the RT-qPCR assays, the two workflows demonstrated general utility, albeit with some differences in conservatism for calculating a LLOQ. These approaches for LLOQ determinations should be applicable to other types of nucleic acid measurements that use calibration curves for quantitation including injury-related miRNAs at sites other than heart and miRNA within tissues and cell lines.

Levels of cardiac-selective miR-208a-3p were measured in biofluids as part of a multi-site study with the expectation based on published literature [16, 17] that low levels would be observed in control plasma and increased levels observed in plasma within 4–24 h of administration of a subcutaneous dose of isoproterenol that induces moderate cardiac injury in male Wistar rats. The levels of miR-208a-3p in the urine of control rats or rats with isoproterenol-induced cardiac injury were an unknown. In this study, we observed that control plasma levels of miR-208a-3p were relatively low and varied by 1000-fold among sites and/or runs, and that the lowest levels (<10 copies/μL biofluid) were associated with large error estimates predicted by the 3-parameter logistic model. When LLOQ thresholds were applied to this dataset that were based on the logistic standard error workflow, it follows that the miR-208a-3p predicted values for unknowns with large confidence intervals in control plasma and in urine are below the LLOQ. The baseline noise workflow for LLOQ determinations that sets a threshold at an interval below the NTC value has a similar effect in filtering out the lower miR-208a-3p estimates with high error estimates. Although there is a rationale for retaining values below the LLOQ to report estimates instead of no results [18], this use case illustrates why error estimates should be calculated and provided for inverse predictions of miRNA copy number concentrations for exploratory biomarker studies.

Conclusions

We developed and tested  two workflows that provide guides for LLOQ determinations and fill a gap in methods that are appropriate for exploratory use of miRNAs as safety biomarkers in drug development. These two workflows are summarized in Additional file 8. We include sample data sets (Additional files 1, 2, 3, 4 and 6) and results tables (Additional files 5 and 7) to allow investigators to train themselves in the use of these guides.

Methods

Synthetic microRNA standards used in the test set

Concentrated stocks of rno-miR-1-3p, rno-miR-16-5p, rno-miR-208a-3p, and rno-miR-499-5p RNA were synthesized, HPLC-purified, quantified, and mixed by a contracting lab (IDT, Coralville, IA), and distributed to test sites as a pooled stock solution comprised of equimolar amounts of four miRNAs. A dilution series was prepared by ten 3-fold serial dilutions of a 1 pmol/L stock of the equimolar pool to span an input range of 1 pmol/L to 17 amol/L. The calibration curve dilutions were prepared in water with carrier non-mammalian RNA (MS bacteriophage RNA, Roche Diagnostics) at a concentration of 0.5 ng/μL.

RT-qPCR protocol for the test set

The test set protocol includes three arms that involve three different degrees of primer pool multiplicity in the reverse transcription and preamplification steps (singleplex, 4-plex, and Megaplex). A single RT reaction was run per arm for 12 samples: an 11-point serial dilution curve of synthetic rno-miR-1-3p and a no template control. The RT reactions were preamplified in replicate on 3 separate days, followed by qPCR. The singleplex assay contained TaqMan microRNA assay reagents for rno-mir-1 (Assay No. 002064). Each 15 μL RT reaction included 0.15 μL 100 mmol/L dNTPs, 1.5 μL 10X RT Buffer, 0.19 μL RNase inhibitor (20 U/μL), 6.16 μL H2O, 3 μL 5× RT primer, 1 μL Multiscribe reverse transcriptase, and 3 μL calibrator RNA or water, and reactions were run in a thermal cycler at 16 °C, 30 min; 42 °C, 30 min; 85 °C, 5 min; 4 °C, hold. The singleplex RT reaction was either preamplified and analyzed by qPCR or analyzed directly by qPCR. Preamplification reactions had 2.5 μL RT reaction, 12.5 μL 2× TaqMan Pre-AMP Master Mix, 6.25 μL 0.2× miR-1 TaqMan assay, and 3.75 μL H2O in a total volume of 25 μL. The reactions were run in a thermal cycler for 14 cycles of [95 °C, 15 s; 60 °C, 4 min] and then placed immediately on ice. The preamplification reaction products were diluted 1:20 in 0.1× TE and 5 μL of diluted preamplification product, undiluted RT reaction, or 1:200 diluted RT reaction was added to a 20 μL qPCR reaction containing 1 uL 20× TaqMan miR-1 microRNA assay, 10 μL 2× Universal Master Mix II no UNG, and 4 μL H2O. Reactions were run at 95 °C for 10 min, followed by 40 cycles of [95 °C, 15 s; 60 °C, 60 s] in an Applied Biosystems 7900HT or ViiA7 qPCR instrument. The same qPCR run parameters were used for the singleplex, 4-plex, and Megaplex qPCR reactions.

The 4-plex RT reaction used pooled RT primers from rno-miR-1-3p, rno-miR-208a-3p, rno-miR-499-5p, and rno-miR-192-5p TaqMan microRNA assays. The 15 μL 4-plex RT reactions consisted of 0.15 μL 100 mmol/L dNTPs, 1.5 μL 10× RT Buffer, 0.19 μL RNase inhibitor (20 U/μL), 3.16 μL H2O, 6 μL 1.25× pooled RT primer, 1 μL Multiscribe reverse transcriptase, and 3 μL calibrator RNA, and were run in a thermal cycler at 16 °C, 30 min; 42 °C, 30 min; 85 °C, 5 min; 4 °C, hold. The 4-plex RT reaction products (2.5 μL) were added to a 25 μL preamplification reaction containing 12.5 μL 2× TaqMan Pre-AMP Master Mix, 6.25 μL 0.2× pooled TaqMan assays for rno-miR-1-3p, rno-miR-208a-3p, rno-miR-499-5p, and rno-miR-192-5p, and 3.75 μL H2O in a total volume of 25 μL. The reactions were run in a thermal cycler for 14 cycles of [95 °C, 15 s; 60 °C, 4 min] and placed immediately on ice. The 4-plex preamplification products were diluted 1:20 and 5 μL was combined with 1 uL 20× TaqMan miR-1 microRNA assay, 10 μL 2× Universal Master Mix II no UNG, and 4 μL H2O.

The Megaplex RT reactions combined 0.8 μL 10× Megaplex RT primers for Rodent Pool A (Catalog No 4399970), 0.2 μL 100 mmol/L dNTPs, 1.5 μL Multiscribe reverse transcriptase, 0.8 μL 10X RT Buffer, 0.9 μL 25 mmol/L MgCl2, 0.1 μL RNase inhibitor (20 U/μL), 0.2 μL H2O, and 3 μL calibrator RNA. The RT reactions were incubated on ice for 5 min and run in a thermal cycler with a heated lid for 40 cycles of [16 °C, 2 min; 42 °C, 1 min; 50 °C, 1 s] followed by 85 °C, 5 min and held at 4 °C. Each Megaplex preamplification reaction contained 12.5 μL 2× TaqMan Pre-AMP Master Mix, 2.5 μL 10× Megaplex PreAMP primers for Rodent Pool A (Catalog No 4399203), 7.5 μL H2O, and 2.5 μL Megaplex RT reaction product. The Megaplex preamplification reactions were run in a thermal cycler at 95 °C, 10 min; 55 °C, 2 min; 72 °C, 2 min, followed by 12 cycles at [95 °C, 15 s; 60 °C, 4 min], followed by 99.9 °C, 10 min and held at 4 °C. Each 25 μL reaction was diluted by adding 75 μL 0.1× TE pH 8.0. The Megaplex preamplification products were further diluted 1:20 and 5 μL was assayed by qPCR by adding 1 μL 20X TaqMan miR-1 microRNA assay, 10 μL 2× Universal Master Mix II no UNG, and 4 μL H2O.

Site differences in the test set

Six sites participated in the study used for the test set. All six ran the singleplex and 4-plex arms and four sites also ran the Megaplex arm. Three different brands of thermal cycler were used by the six sites for the RT and preamplification steps. Three sites used the Applied Biosystems 7900HT system and three sites used the Applied Biosystems ViiA7 system for qPCR steps. The one reported variable within a site was the use of three different lots of TaqMan PreAmp MasterMix by Site C.

Software

Calculations were performed in Excel and JMP, and graphics were created in Excel, GraphPad, and JMP. A free JMP add-in called “Calibration Curves” is available at https://community.jmp.com/docs/DOC-6285 to aid in fitting 3PL curves and performing inverse prediction.

References

  1. Landgraf P, Rusu M, Sheridan R, Sewer A, Iovino N, Aravin A, et al. A mammalian microRNA expression atlas based on small RNA library sequencing. Cell. 2007;129(7):1401–14.

    Article  CAS  Google Scholar 

  2. Minami K, Uehara T, Morikawa Y, Omura K, Kanki M, Horinouchi A, Ono A, Yamada H, Ohno Y, Urushidani T. miRNA expression atlas in male rat. Sci Data. 2014;1:140005.

    Article  CAS  Google Scholar 

  3. Smith A, Calley J, Mathur S, Qian H-R, Wu H, Farmen M, Caiment F, Bushel PR, Li J, Fisher C, Kirby P, Koenig E, Hall DG, Watson DE. The rat microRNA body atlas; evaluation of the microRNA content of rat organs through deep sequencing and characterization of pancreas enriched miRNAs as biomarkers of pancreatic toxicity in the rat and dog. BMC Genomics. 2016;17:694.

    Article  Google Scholar 

  4. Roberts TC, Coenen-Stass AML, Wood MJA. Assessment of RT-qPCR normalization strategies for accurate quantification of extracellular microRNAs in murine serum. PLoS One. 2014;9(2):e89237.

    Article  Google Scholar 

  5. Kroh EM, Parkin RK, Mitchell PS, Tewari M. Analysis of circulating microRNA biomarkers in plasma and serum using quantitative reverse transcription-PCR (qRT-PCR). Methods. 2010;50(4):298–301.

    Article  CAS  Google Scholar 

  6. Guidance for Industry, Bioanalytical Method validation, U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, September 2013, Rev 1.

  7. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, Kubista M, Mueller R, Nolan T, Pfaffl MW, Shipley GL, Vandesompele J, Wittwer CT. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009;55(4):611–22.

    Article  CAS  Google Scholar 

  8. Hindson CM, Chevillet JR, Briggs HA, Gallichotte EN, Ruf IK, Hindson BJ, Vessella RL, Tewari M. Absolute quantification by droplet digital PCR versus analog real-time PCR. Nat Methods. 2013;10:1003–5.

    Article  CAS  Google Scholar 

  9. Miotto E, Saccenti E, Lupini L, Callegari E, Negrini M, Ferracin M. Quantification of circulating miRNAs by droplet digital PCR: comparison of EvaGreen- and TaqMan-based chemistries. Cancer Epidemiol Biomark Prev. 2014;23(12):2638–42.

    Article  CAS  Google Scholar 

  10. Thompson KL, Boitier E, Chen T, Couttet P, Ellinger-Ziegelbauer H, Goetschy M, Guillemain G, Kanki M, Kelsall J, Mariet C, de La Moureyre–Spire C, Mouritzen P, Nassipour R, O’Lone R, Pine PS, Rosenzweig BA, Sharapova T, Smith A, Uchiyama H, Yan J, Yuen PS, Wolfinger R. Absolute measurement of cardiac injury-induced microRNAs in biofluids across multiple test sites. Toxicol Sci. 2016;154(1):115–25.

    Article  CAS  Google Scholar 

  11. Kelnar K, Peltier HJ, Leatherbury N, Stoudemire J, Bader AG. Quantification of therapeutic miRNA mimics in whole blood from nonhuman primates. Anal Chem. 2014;86:1534–42.

    Article  CAS  Google Scholar 

  12. Hughes S, Byrne A, Barfield M, Spooner N, Summerfield S. Preliminary investigation into the use of a real-time PCR method for the quantification of an oligonucleotide in human plasma and the development of novel acceptance criteria. Bioanalysis. 2014;6:127–36.

    Article  CAS  Google Scholar 

  13. Exiqon miRCURY LNA™ Universal RT microRNA PCR. Instruction manual v5.2, March 2013.

  14. Gallant AR. Nonlinear statistical models. New York: John Wiley & Sons; 2009.

    Google Scholar 

  15. Guidance for Industry, Q2B Validation of Analytical Procedures: Methodology, U.S. Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, November 1996.

  16. Glineur SF, De Ron P, Hanon E, Valentin JP, Dremier S, Nogueira da Costa A. Paving the route to plasma miR-208a-3p as an acute cardiac injury biomarker: preclinical rat data supports its use in drug safety assessment. Toxicol Sci. 2016;149:89–97.

    Article  CAS  Google Scholar 

  17. Wang G-K, Zhu J-Q, Zhang J-T, Li Q, Li Y, He J, Qin Y-W, Jing Q. Circulating microRNA: a novel potential biomarker for early diagnosis of acute myocardial infarction in humans. Eur Heart J. 2010;31(6):659–66.

    Article  Google Scholar 

  18. Lee JW, Devanarayan V, Barrett YC, Weiner R, Allinson J, Fountain S, Keller S, Weinryb I, Green M, Duan L, Rogers JA, Millham R, O'Brien PJ, Sailstad J, Khan M, Ray C, Wagner JA. Fit-for-purpose method development and validation for successful biomarker measurement. Pharm Res. 2006;23(2):312–28.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We thank the microRNA best practices working group of the HESI Technical Committee on Application of Genomics to Mechanism-based Risk Assessment for providing the independent inter-laboratory study dataset.

Funding

This HESI scientific initiative is primarily supported by in-kind contributions (from public and private sector participants) of time, expertise, and experimental effort. These contributions are supplemented by direct funding (that largely supports program infrastructure and management) that was provided by HESI’s corporate sponsors. A list of supporting organizations (public and private) is available at http://hesiglobal.org/application-of-genomics-to-mechanism-based-risk-assessment-technical-committee/.

Availability of data and materials

The datasets supporting the conclusions of this article are included within the article and its additional files.

Disclaimer

The statements, opinions, and conclusions expressed herein do not necessarily represent the views or positions of the authors’ institutions. Certain commercial entities, equipment, or materials may be identified in this document in order to describe an experimental procedure or concept adequately. Such identification is not intended to imply recommendation or endorsement by any of the authors’ institutions, nor is it intended to imply that the entities, materials, or equipment are necessarily the best available for the purpose.

Author information

Authors and Affiliations

  1. SAS Institute Inc., Cary, NC, 27513, USA

    Russell D. Wolfinger

  2. Alkermes Inc., Waltham, MA, 02451, USA

    Sudheer Beedanagari

  3. Sanofi R&D, Disposition Safety and Animal Research, Vitry-sur-Seine, France

    Eric Boitier & Claire Mariet

  4. Division of Genetic and Molecular Toxicology, National Center for Toxicological Research, Food and Drug Administration, Jefferson, AR, 72079, USA

    Tao Chen & Jian Yan

  5. Novartis Pharma AG, CH-4057, Basel, CH, Switzerland

    Philippe Couttet & Gregory Guillemain

  6. Toxicology, Bayer Pharma AG, 42096, Wuppertal, Germany

    Heidrun Ellinger-Ziegelbauer

  7. Exiqon, DK-2950, Vedbaek, Denmark

    Peter Mouritzen

  8. ILSI Health and Environmental Sciences Institute, 1156 15th NW, 2nd Floor, Washington, DC, 20005, USA

    Raegan O’Lone

  9. National Institute of Standards and Technology, Stanford, CA, 94305, USA

    P. Scott Pine

  10. AbbVie, Abbott Park, IL, 60064, USA

    Tatiana Sharapova

  11. NIH/NIDDK, Bethesda, MD, 20892, USA

    Peter S. Yuen

  12. Center for Drug Evaluation and Research, Food and Drug Administration, Silver Spring, MD, 20993, USA

    Karol L. Thompson

  13. Bristol Myers Squibb, New Brunswick, NJ, USA

    Sudheer Beedanagari

Authors
  1. Russell D. Wolfinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sudheer Beedanagari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eric Boitier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Philippe Couttet
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Heidrun Ellinger-Ziegelbauer
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Gregory Guillemain
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Claire Mariet
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Peter Mouritzen
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Raegan O’Lone
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. P. Scott Pine
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Tatiana Sharapova
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Jian Yan
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Peter S. Yuen
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Karol L. Thompson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RDW, EB, TC, PC, HEZ, PM, PSP, TS, PSY, and KLT developed the concept of the report. HEZ, SB, TC, JY, TS, PC, GG, CM, and KLT provided data for the test set. RDW developed the logistic model approach and KLT developed the baseline noise method. RDW and KLT drafted the manuscript. ROL provided overall program management. All authors participated in the revision process and provided final approval.

Corresponding author

Correspondence to Raegan O’Lone.

Ethics declarations

Authors’ information

Not applicable.

Ethics approval and consent to participate

All animal studies were performed in compliance with the European Directive 2010/63/EU on the Protection of Animals used for Scientific Purposes.

Consent for publication

Not applicable.

Competing interests

PM is an employee of Exiqon, which is a company that is a developer and producer of qPCR systems for detection of coding and noncoding RNAs. RDW is an employee of SAS Institute, which develops software for bioinformatics analysis. The other authors declare that they have no competing interests.

Additional files

Additional file 1:

Multi-site miRNA calibration curve dataset for the singleplex no preamp RT-qPCR pipeline. Results for the miR-1 calibration curves that were generated at six sites (A-F) as described in Methods are provided. (CSV 1 kb)

Additional file 2:

Multi-site miRNA calibration curve dataset for the singleplex preamp RT-qPCR pipeline. (CSV 2 kb)

Additional file 3:

Multi-site miRNA calibration curve dataset for the 4-plex preamp RT-qPCR pipeline (CSV 2 kb)

Additional file 4:

Multi-site miRNA calibration curve dataset for the Megaplex preamp RT-qPCR pipeline. (CSV 1 kb)

Additional file 5:

LLOQ determinations based on Logistic Modeling and Baseline Noise approaches for datasets in Additional files 1-4 and plotted in Fig. 5. (CSV 2 kb)

Additional file 6:

miR-208a-3p calibration curve dataset from 5 sites used for LLOQ determinations in Additional file 5. (CSV 11 kb)

Additional file 7:

Predicted miR-208a-3p values in plasma and urine from control and isoproterenol-treated rats and the corresponding LLOQs determined using two workflows and plotted in Fig. 6. (CSV 10 kb)

Additional file 8:

Summary of Logistic Modeling and Baseline Noise approaches to LLOQ determinations. (PDF 55.1 KB)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wolfinger, R.D., Beedanagari, S., Boitier, E. et al. Two approaches for estimating the lower limit of quantitation (LLOQ) of microRNA levels assayed as exploratory biomarkers by RT-qPCR. BMC Biotechnol 18, 6 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s12896-018-0415-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12896-018-0415-4

Keywords

BMC Biotechnology

ISSN: 1472-6750

Contact us