Skip to main content
  • Methodology article
  • Open access
  • Published:

Systematic cross-validation of 454 sequencing and pyrosequencing for the exact quantification of DNA methylation patterns with single CpG resolution



New high-throughput sequencing technologies promise a very sensitive and high-resolution analysis of DNA methylation patterns in quantitative terms. However, a detailed and comprehensive comparison with existing validated DNA methylation analysis methods is not yet available. Therefore, a systematic cross-validation of 454 sequencing and conventional pyrosequencing, both of which offer exact quantification of methylation levels with a single CpG dinucleotide resolution, was performed.


To this end the methylation patterns of 12 loci (GSTπ1, p16INK4a, RASSF1A, SOCS1, MAL, hsa-mir-1-1, hsa-mir-9-3, hsa-mir-34a, hsa-mir-596, hsa-mir-663, MINT31, and LINE-1) were analyzed in ten primary hepatocellular carcinoma specimens. After applying stringent quality control criteria, 35749 sequences entered further analysis. The methylation level of individual CpG dinucleotides obtained by 454 sequencing was systematically compared with the corresponding values obtained by conventional pyrosequencing. Statistical analyses revealed an excellent concordance of methylation levels for all individual CpG dinucleotides under study (r2 = 0.927).


Our results confirm that 454 sequencing of bisulfite treated genomic DNA provides reliable high quality quantitative methylation data and identify MAL, hsa-mir-9-3, hsa-mir-596, and hsa-mir-663 as new targets of aberrant DNA methylation in human hepatocelluar carcinoma. In addition, the single molecule resolution of 454 sequencing provides unprecedented information about the details of DNA methylation pattern heterogeneity in clinical samples.


Traditionally, cancer has been regarded as a disease that is driven by progressive genetic abnormalities including mutations and chromosomal aberrations in tumor-suppressor genes and oncogenes. However, it has become clear that cancer is also driven by 'epigenetic changes' -- patterns of altered gene expression that are mediated by mechanisms that do not affect the primary DNA sequence [1]. The main epigenetic mechanisms are DNA methylation, histone modifications and non-coding RNAs. DNA methylation represses transcription directly, by inhibiting the binding of specific transcription factors, and indirectly, by recruiting methyl-CpG-binding proteins and their associated repressive chromatin remodeling activities [2]. Since the hypermethylation of CpG islands is relatively rare in normal cells, and often an early event in transformation, it represents a promising biomarker for early cancer detection [3].

The methylation status of DNA can be detected by several methods [4]. To measure methylation levels, bisulfite conversion has been combined with restriction analysis (COBRA [5]), base-specific cleavage and mass spectrometry [6], real-time PCR (MethyLight, [7]), and pyrosequencing [8]. However, not all of these methods provide quantitative data with a single CpG resolution. The technique considered by many in the field as the gold standard is bisulfite genomic sequencing, which examines multiple subclones of a bisulfite PCR product [9]. However, if only 5 - 10 clones are sequenced (as in most published studies) this approach is at best semi-quantitative and not very sensitive.

Over the past five years, DNA sequencing technology has evolved rapidly. Among others, a novel massively parallel sequencing-by-synthesis method was introduced that is based on pyrosequencing in picoliter-scale reactions ("454 sequencing"). The 454 technology generates ~ 400,000 reads per instrument-run at lengths of 200 to 300 bp with an accuracy of 99.6% [10]. With the introduction of new reagents the average read length is increased to 400 - 500 bp [11]. In principle, the large number of sequence reads per amplicon (dozens or even hundreds) offers the opportunity to obtain precise quantitative methylation data for every single CpG site contained within the amplicon. To the best of our knowledge, this has not yet been studied comprehensively employing rigorous statistical tools.

Therefore, we cross-validated 454 amplicon bisulfite sequencing and conventional pyrosequencing, which is a well established and validated, highly quantitative method for the exact quantification of DNA methylation patterns with single CpG resolution by measuring the methylation level of 89 CpG dinucleotides from 12 loci in 10 patient samples.


Selection of loci

In order to explore the feasibility of quantitative methylation studies using 454 sequencing, a range of genomic loci was selected for in-depth analysis: tumor-suppressor genes reported to be frequently hypermethylated in hepatocellular carcinoma (p16INK4a, RASSF1A, SOCS-1, GSTπ1, [12] and references therein), classical non-protein coding CIMP loci also reported to be methylated in HCC (MINT31, [13]), and microRNA genes identified by our own group to be aberrantly methylated in HCC (mir-9-3, mir-34a, mir-596, mir-663). Since Datta et al. [14] reported aberrant hypermethylation of mir-1-1 in HCC, this microRNA was also included in the analysis. In addition, LINE-1 sequences were analyzed because these repetitive elements often display marked hypomethylation and a high sequence heterogeneity which might be ascertainable by a deep bisulfite sequencing approach.

Mapping the bisulfite sequencing results

A total of 59,366 sequences were obtained in a single run using a fraction of a small 454 sequencing plate (25×75 PicoTiterPlate). The maximum expected number of reads for this setting is about 70,000. The average read length was 210 bp (range, 53-325 bp). Bioinformatic analysis consisted of the following three steps: (a) matching each sequence to a unique tagged primer, (b) mapping the amplicon sequences to the in silico bisulfite-converted genomic sequence, and (c) compiling sequence identity, sodium bisulfite conversion efficiency and the methylation state for each CpG site. (see Materials and Methods). Of the 59,366 sequences, 50,118 (84.4%) were mapped to a unique amplicon. The two main sequence errors observed were the detection of unconverted (or only partially converted) sequences in individual reads and small deletions in homopolymeric stretches.

On average, 298 sequence reads were obtained for each amplicon after filtering. However, the yield per amplicon was quite variable. The number of reads per amplicon ranged from 0 to 1487 (mean: 297.9, median: 238.8). A detailed analysis of the number of reads obtained (after filtering) for each locus in all 10 samples under study after filtering can be found in Additional File 1. This variation may be caused by the secondary structure of each amplicon, amplicon length, GC content, overall methylation status, and the number of homopolymers present after bisulfite treatment which all effect the linker ligation and emulsion PCR as well as the efficiency of single molecule sequencing reaction. Statistical analysis revealed a significant influence of the amplicon length on the mean number of reads (r = -0.81). In contrast, the tendency for secondary structure and the GC content show only a weak or no influence on the number of reads (see Additional File 2).

Quantitative DNA methylation analysis of individual CpG islands

Based on the quality of the alignment, reads with a sequence identity of less than 90% and less than 100% sodium bisulfite conversion were filtered out. After filtering, a total of 35,749 sequences (60.2%) were used for computing the methylation level at each individual CpG dinucleotide. The percentage of methylation at each CpG site was calculated based on the number of sequences containing unconverted cytosine (indicating methylation in the original sequence) versus the total number of sequences analyzed (Figure 1).

Figure 1
figure 1

Methylation profile of 12 loci in 10 HCC samples. Each column represents a CpG site in each DNA sequence. The names of the genes are listed above of each set. The sample number is labeled on the left side of each row. The color indicates the methylation level. White, no methylation; black, methylation. The proportion of black and white in each column indicates the percentage of sequences containing the methylated CpG sites at this position. The sequencing result of one sample (marked by an asterisk) did not pass the quality control (see Materials and Methods) and was not included in the figure.

Overall our results for GSTπ1, p16INK4a, RASSF1A, SOCS1 and MINT31 are consistent with what others have previously reported for HCC (Table 1) [12, 13, 1518]. The methylation results for LINE-1 elements, hsa-mir-1-1 and the newly identified targets MAL, hsa-mir-9-3, hsa-mir-596, and hsa-mir-663, are also compiled in Table 1.

Table 1 Methylation profile of all loci across the 10 HCC samples analyzed in this study.

In order to identify allele specific methylation SNPs were identified in the regions under study. Only for GSTπ1, miR-663, p16INK4a, and RASSF1A could potentially informative SNPs be found. C/T polymorphisms were excluded because of the bisulfite treatment and small deletions/insertions were excluded because of difficulties discriminating between true deletions/insertions and 454 sequencing errors. The remaining (small) number of SNP sites did not reveal anything about allele specific methylation.

Systematic comparison of 454 sequencing with conventional pyrosequencing

Conventional pyrosequencing and 454 sequencing can both be used to quantify the methylation level at every CpG dinucleotide contained within a given sequence. Since no systematic cross-validation of these two methods has been performed so far and only limited data are available about the reliability of 454 sequencing for the purpose of exact quantification of methylation levels (see Discussion), a detailed comparison of the quantitative methylation profile of all 12 loci in all 10 samples was performed. To this end, pyrosequencing assays were designed in such a way that the sequence to analyze was contained completely within the amplicon analyzed by 454 sequencing. Bisulfite treatment for 454 sequencing and conventional pyrosequencing was performed independently for all 10 tumor samples under study.

Overall, the mean methylation levels obtained by pyrosequencing and 454 sequencing showed an excellent correlation for every gene in all samples (Figure 2). Also a comparison of the methylation levels of individual CpG sites showed an excellent concordance between both methods for all loci under study (Figure 3).

Figure 2
figure 2

Cross-validation of 454 sequencing and conventional pyrosequencing: mean methylation level. Comparison of mean methylation levels for all genes in all samples: pyrosequencing and 454 sequencing data show an excellent congruence. The sequencing result of one sample (marked by an asterisk) did not pass the quality control (see Materials and Methods) and was not included in the figure. Grey columns: 454 sequencing, black columns: pyrosequencing

Figure 3
figure 3

Cross-validation of 454 sequencing and conventional pyrosequencing: individual methylation levels. Comparison of the methylation levels of individual CpG dinucleotides of selected genes in selected samples: Even samples with a very heterogeneous methylation pattern (e.g. p16INK4A) display an excellent congruence. (■) 454 sequencing, () pyrosequencing

In Figure 4) a Bland-Altman-Plot is shown to demonstrate the congruence of both methods. In Additional File 3 the Bland-Altman-Plots for each individual locus is shown. A difference of less than 10 percentage points was judged to be acceptable considering the technical variability of conventional pyrosequencing which is in the range of 2 - 10 percentage points [19]. The 95% tolerance intervals for 10 out of 12 loci are well within the range of +/- 10 percentage points.

Figure 4
figure 4

Comparison of pyrosequencing and 454 sequencing using Bland-Altman Plots. Bland-Altman-Plot: Difference in methylation level obtained by both methods versus the mean of the methylation level for all 12 loci in all 10 samples. The individual Bland-Altman-Plots can be found in the Additional File 3. The upper and lower dotted lines indicate the 95% tolerance interval.

Regression analysis of the methylation levels of all individual CpG sites under study obtained independently by the two methods revealed a very good concordance (Figure 5, r2 = 0.927, slope: 0.918, 95% confidence interval: 0.9067 to 0.9300). A regression analysis of the mean methylation levels of all samples, which diminishes the influence of outliers, results in an even better concordance (r2 = 0.957, slope: 0.9317, 95% confidence interval: 0.9078 to 0.9556, data not shown). The results of the regression analysis performed for all 12 loci individually are shown in Additional File 4.

Figure 5
figure 5

Comparison of pyrosequencing and 454 sequencing using regression analysis. Regression analysis was performed for all individual measurements (methylation level of each individual CpG site under study, n = 869) obtained by the two methods. The excellent concordance of both methods is obvious (r2 = 0.927, p < 0.0001, slope: 0.918, 95% confidence interval: 0.9067 to 0.9300).

Calculating the differences in relative methylation obtained by the two methods for each individual CpG site under study, revealed that for the vast majority of measurements (720/869, 82.8%) a good congruence (i.e., less than 10 percentage points deviation) was observed. 514 out of 869 measurements (59.1%) gave a very good congruence (i.e., less than 5 percentage points deviation), 288/869 measurements (33.1%) a perfect match with less than 2 percentage points deviation. For more details see Additional File 5.

Analysis of the miR-663 gene gave the worst congruence between pyrosequencing and 454 sequencing. The most likely reason for this is the very low number of 454 sequence reads obtained for this locus. This low efficiency is most probably due to the length of the amplicon (with 312 bp the longest in this study), the tendency to form secondary structures (see Additional File 1) and the extremely high GC content of this locus (%GC: 62.2%, CpGobs/CpGexp: 0.94), which also made the design of a conventional pyrosequencing assay difficult. One sample (HCC 9) for miR-663 was left out from analysis because the quality control criteria of the methylation data analysis software were not met (see also legend to Figure 2). Sample 8 and 10 also yielded only 2 sequences each, and were left out from further statistical analyses. Therefore, the total number of CpG sites under study is 869 (and not 890). Figure 6 shows clearly a correlation between number of reads per amplicon and the congruence of both methods: High read numbers result in better congruence. The samples with a difference between both methods outside the 95% confidence interval all have low read numbers (below 175).

Figure 6
figure 6

Relationship between congruence and coverage. The difference between both methods (as a measure of congruence) was plotted against the number of reads obtained by 454 sequencing. Above coverage of 175 reads per sample no difference lies outside the 95% confidence interval.

Therefore, a minimum of 100 - 150 reads per amplicon should be achieved for proper quantification of methylation levels be 454 sequencing. Using a full GS20 plate approximately 30 genes in 100 samples could be analyzed in a single run. In contrast to pyrosequencing, which provides an average methylation level for each CpG dinucleotide across a possibly very heterogeneous population of individual DNA molecules, 454 sequencing delivers a single molecule resolution. This reveals, for example, that only very few completely methylated LINE-1 alleles can be found, whereas for the MINT1 locus a substantial amount of individual alleles is fully methylated (Additional File 6). Other genes display a remarkable heterogeneity in the pattern of DNA methylation across samples: RASSF1A for example displays in some samples (with very few exceptions) only fully methylated or fully unmethylated alleles whereas in other samples a much more diverse pattern is found (Additional File 7).


Large scale methylome studies become more and more important in biomedical sciences and high throughput sequencing technologies promise large scale sensitive, quantitative and high resolution DNA methylation analysis. However, the reliability of the quantification of the methylation level of individual CpG sites by these new sequencing technologies has not been explored comprehensively. Therefore, we compared massive parallel bisulfite sequencing using 454 technology with conventional pyrosequencing. The reliability of conventional pyrosequencing has already been demonstrated in several comparative studies by comparing the results with the output of other methodologies (e.g., SnaPShot [20] or COBRA [5] or by analyzing samples with defined methylation status, like cell line DNA [21]. The reproducibility of conventional bisulfite pyrosequencing technology proved to be excellent [8, 22].

Despite the fact that several studies already describe the use of 454 bisulfite sequencing for quantitative analysis of methylation data (see below) no comprehensive comparison of these methodologies has been performed so far:

In their pioneering study, Taylor et al. [23] compared methylation data from 454 sequencing, qMSP and conventional bisulfite sequencing for three genes. The data were obtained from the analysis of three sample pools and in vitro methylated DNA (Figure 3 in Taylor et al.). Since no statistical analysis is presented in this publication, the extent of congruence seems to be judged by visual inspection of the figures. Ordway et al. [24] compared the mean methylation level obtained by 454 sequencing with the relative methylation density measured by real-time PCR for four genes and found a reasonable correlation (r2: 0.45 - 0.87) with respect to this average value (Figure 5, A, C, E, G in Ordway et al.). Xie et al. [25] also compared the mean methylation level obtained by 454 sequencing for various Alu elements with the mean methylation level obtained by conventional pyrosequencing (Figure 4 in Xie et al.). For six loci sufficient data were available for a comparison. The outcome was quite variable, from perfect congruence to clear discordance (e.g., 25% versus 65%). One reason might be the sequence heterogeneity even within subgroups of Alu elements [26]. Varlay et al. [27] compared 454 sequencing data to COBRA results from the same sample for 14 tumors. All samples classified as "methylated" by COBRA had a substantial proportion of molecules (> 15%) with dense methylation in the proximal promoter. The authors defined "dense methylation" as "greater than 50% of CpGs methylated" (Table 1 in Varley et al.). Since no details of the evaluation of the COBRA data are given and no primary COBRA data are displayed, a comprehensive judgment of the degree of congruence is not possible. Also, no comparison for individual CpG dinucleotides has been performed. Korshunowa et al. [28] describe no cross-validation in their study, but this manuscript is from the same group as the above cited publication from Ordway et al. [24]. Therefore, the results are indirectly linked to the comparison described in the latter study. Zeschnigk et al. [29] compared the overall methylation pattern of selected CpG islands obtained by 454 sequencing with the results of conventional bisulfite sequencing. Since they were interested in global methylation patterns, a systematic comparison of methylation levels of individual CpG dinucleotides was not performed. Further, the low coverage achieved in this study (less than 10 reads for the vast majority of CGIs and approx. 10 cloned PCR fragments per locus) did not permit a precise quantification with single-CpG resolution. Hodges et al. [30] compared high throughput sequencing data obtained by an Illumina GA2 platform with conventional bisulfite sequencing of individual clones. For the majority of the CpG sites under study the 90% confidence intervals overlap, but the deviation of the calculated methylation levels is much larger than in this study (supplementary Table two in Hodges et al.). However, these data are not directly comparable since sample preparation, primary output and subsequent data processing are quite different from the 454 sequencing platform.

One limitation of 454 sequencing is the accurate resolution of homopolymer sequences. Because there is no terminating moiety preventing multiple repeated incorporations at a given nucleotide injection cycle, the length of a homopolymeric stretch must be inferred from the signal intensity. This is prone to a greater error rate than the discrimination of incorporation versus non-incorporation [31]. However, the quantification tool for methylation analysis used in this study (QUMA, [32]) was able to accurately align the fragments even if there were gaps present in a homopolymeric region. A few amplicons did not produce a sufficient number of high-quality reads for the quantification of cytosine methylation (i.e., miR-663). This may be due to the amplification bias at the library preparation step, resulting in a bias of the fragments generated during the emulsion PCR reaction. However, an insufficient number of reads was obtained for only 3 of the 120 amplicons (2.5%).

A clear advantage of 454 sequencing is the higher sensitivity for the detection of low level methylation. The 1.4% of fully methylated LINE-1 alleles detected in sample no. 8 (see Additional File 6) are not detectable by conventional pyrosequencing due to the inherent background. Depending on the quality of the assay the background signals are in the range of several percentage points. Since the vast majority of LINE-1 sequences are more than 90% similar to each other in the CpG islands contained within the 5'-UTR, a detailed analysis of the different LINE-1 family members would require the amplification and sequencing of much larger regions. However, these other, more diverse regions do not qualify as CpG islands and are most likely not directly affected by differential methylation.

Our data demonstrate that the two different methodologies yielded very similar methylation values obtained for the large majority of CpG sites (82.8%) even for very heterogeneous methylation patterns as exemplified by the p16INK4agene (range of methylation levels of individual CpG dinucleotides: 10 - 70%, see Figure 3). Further, for low level methylation levels as seen in miR-34a, a very high congruence was achieved. This remarkable concordance serves as a powerful validation for both technical approaches which has not previously been demonstrated.


The 454 technology enables a much more comprehensive coverage of whole CpG islands and the single molecule resolution provides unprecedented information about the heterogeneity of methylation patterns (a few examples are provided in Additional File 7). It also offers the possibility of studying many loci in parallel. These advantages come with a considerable initial investment, expansive reagents, low turn-around time, and a time-consuming data processing and evaluation step, making it primarily a research tool. By contrast, conventional pyrosequencing is generally much faster, easier and cheaper. Provided that only a single locus has to be analyzed at regular intervals, and that the differentially methylated region of interest is well characterized and quite small, as is the case for routine diagnostic applications (e.g., analyzing MGMT gene methylation in glioblastoma [33] or hMLH1 gene methylation in colorectal carcinoma [34]) conventional pyrosequencing remains the method of choice.

Therefore, in our opinion conventional pyrosequencing and 454 sequencing are not competing but complementary methodologies fulfilling different functions in the field of DNA methylation analysis.


Tissue specimens and bisulfite modification of DNA

All hepatocellular carcinoma (HCC) samples were retrieved from the archive of the Institute of Pathology, Hanover Medical School (Germany) and analyzed anonymously following the guidelines of the local Ethics committee ("Ethik-Kommission der Medizinischen Hochschule Hannover", head: Prof. Dr. Tröger). Tumor cell content was determined to be greater than 70%. DNA was isolated by digestion with proteinase K (Merck, Darmstadt, Germany) followed by phenol/chloroform extraction from a total of 10 specimens (Additional File 8). Genomic DNA (1 μg) from tumor specimens was treated with sodium bisulfite using the Imprint™ DNA Modification Kit (Sigma, Saint Louis, Missouri) following the protocol supplied by the manufacturer.

Primer design and PCR

Specific primers were designed for 12 loci using publicly available software ( A ten or nine-nucleotide sample-specific tag was added to the 5' end of each forward primer sequence so that each sample could be computationally separated after 454 sequencing analysis. The tag sequences were provided by Roche (Mannheim, Germany). PCR was performed for 33 - 36 cycles in a 50 μl reaction using annealing temperatures from 60°C to 65°C, depending on the locus under study. A complete list of the 120 primer pairs is available in Additional File 9. Denaturation (95°C), annealing, and extension (72°C) times were 30 s, 45 s, and 1 min, respectively. Each amplicon was individually prepared, gel purified, and quantified by Quant-IT PicoGreen kit (Invitrogen, Eugene, Oregon).

454 sequencing

For a single 454 sequencing run one hundred twenty amplicons were pooled in equimolar amounts in a single tube. For some amplicons a precipitation step was necessary to increase the concentration. This was performed following standard procedures using ethanol and sodium acetate and glycogen (Sigma, Saint Louis, Missouri) as a carrier. The emulsion PCR and subsequent sequencing reaction were performed exactly as described in the GS FLX emPCR Method Manual (USM-00033.A, Roche, Mannheim, Germany).

One region of a PicoTiterPlate (25×75) was used with GS FLX-chemistry. Using this configuration the expected yield is approx. 70,000 reads and 17.5 Mbp sequence content in total.

Methylation analysis using Pyrosequencing

PCR products were generated in a 25 μL reaction volume with 400 nmol/L of forward, 40 nmol/L reverse and 400 nmol/L universal biotinylated primers, 200 μmol/L of each dNTP, 1.5 mmol/L or 2.5 mmol/L MgCl2 (see Additional FIle 9 for all primer sequences and reaction conditions), 1x Platinum-Taq reaction buffer and 1.25 units PlatinumTaq™ (Invitrogen, Karlsruhe, Germany). PCR conditions were 95°C for 5 minutes, followed by 45 cycles with denaturation at 95°C for 30 seconds, annealing at 55°C or 60°C for 45 seconds, and elongation at 72°C for 30 seconds finished with 1 cycle final elongation at 72°C for 5 minutes. The reverse primer is tagged by a sequence recognized by the universal primer. Therefore, a single (expansive) biotinylated primer can be used for all different gene-specific assays [21].

PCR products (5-20 μL) were added to a mix consisting of 3 μL Streptavidin Sepharose HP™ (Amersham Biosciences, Freiburg, Germany) and 37 μL binding buffer (Qiagen, Hilden, Germany) and mixed at 1200 rpm for 5 minutes at room temperature.

Using the Vacuum Prep Tool™ (Qiagen, Hilden, Germany), single-stranded PCR products were prepared following the manufacturer's instructions. The sepharose beads with the single stranded templates attached were released into a PSQ 96 Plate Low™ (Qiagen, Hilden, Germany) containing a mix of 12 μL annealing buffer (Qiagen, Hilden, Germany) and 500 nmmol/L of the corresponding sequencing primer (see Additional File 9). Pyrosequencing™ reactions were performed in a PyroMark MD System (Qiagen, Hilden, Germany) according to the manufacturer's instructions using the PyroGold SQA™ Reagent Kit (Qiagen, Hilden, Germany). CpG site quantification was performed using the methylation Software Pyro Q-CpG™.

Sequence analysis

59,366 reads were obtained from a single run. All the 454 sequences came in one large FASTA file with one sequence read per entry. The sequences were from the forward strand. The primers were composed of a 9-10 nucleotide initial sequence used as a tag to identify the sample. Primary analysis of the sequencing results was conducted using the freely available next-generation sequence software Galaxy ( Each amplicon sequence was assigned to 1 of the 12 loci under study based on the tagged locus-specific primers. To determine sequence identity, sodium bisulfite conversion efficiency and the methylation state for each CpG site, the amplicon sequences were analyzed by using a web-based freely available quantification tool for methylation analysis (QUMA, [32]). The percent identity scores were set at 90% and CpH conversion efficiency were set at 100%. The sequences were then filtered at 90% sequence identity and 100% CpH conversion efficiency.

Statistical analyses were carried out using Microsoft Excel, GraphPad Prism5 and QUMA [32] software.

For the comparison of the two methods Bland-Altman-Plots were generated [35]. In these plots the difference of two methods is plotted against the average of both methods. A comprehensive description of this type of data presentation by Altman and Bland ("Measurements in Medicine: the Analysis of Method Comparison Studies", The Statistician 32 (1983) 307 - 317) can be found freely available at:



cytosine followed by adenine, thymine, or cytosine




quantitative Methylation-specific PCR


  1. Ting AH, McGarvey KM, Baylin SB: The cancer epigenome--components and functional correlates. Genes Dev. 2006, 20 (23): 3215-3231. 10.1101/gad.1464906.

    Article  Google Scholar 

  2. Robertson KD: DNA methylation and chromatin - unraveling the tangled web. Oncogene. 2002, 21 (35): 5361-5379. 10.1038/sj.onc.1205609.

    Article  Google Scholar 

  3. Laird PW: The power and the promise of DNA methylation markers. Nat Rev Cancer. 2003, 3 (4): 253-266. 10.1038/nrc1045.

    Article  Google Scholar 

  4. Zuo T, Tycko B, Liu TM, Lin HJ, Huang TH: Methods in DNA methylation profiling. Epigenomics. 2009, 1 (2): 331-345. 10.2217/epi.09.31.

    Article  Google Scholar 

  5. Xiong Z, Laird PW: COBRA: a sensitive and quantitative DNA methylation assay. Nucleic Acids Res. 1997, 25 (12): 2532-2534. 10.1093/nar/25.12.2532.

    Article  Google Scholar 

  6. Ehrich M, Nelson MR, Stanssens P, Zabeau M, Liloglou T, Xinarianos G, Cantor CR, Field JK, van den Boom D: Quantitative high-throughput analysis of DNA methylation patterns by base-specific cleavage and mass spectrometry. Proc Natl Acad Sci USA. 2005, 102 (44): 15785-15790. 10.1073/pnas.0507816102.

    Article  Google Scholar 

  7. Eads CA, Danenberg KD, Kawakami K, Saltz LB, Blake C, Shibata D, Danenberg PV, Laird PW: MethyLight: a high-throughput assay to measure DNA methylation. Nucleic Acids Res. 2000, 28 (8): E32-10.1093/nar/28.8.e32.

    Article  Google Scholar 

  8. Dupont JM, Tost J, Jammes H, Gut IG: De novo quantitative bisulfite sequencing using the pyrosequencing technology. Anal Biochem. 2004, 333 (1): 119-127. 10.1016/j.ab.2004.05.007.

    Article  Google Scholar 

  9. Liu L, Wylie RC, Hansen NJ, Andrews LG, Tollefsbol TO: Profiling DNA methylation by bisulfite genomic sequencing: problems and solutions. Methods Mol Biol. 2004, 287: 169-179.

    Google Scholar 

  10. Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, Bemben LA, Berka J, Braverman MS, Chen YJ, Chen Z, et al: Genome sequencing in microfabricated high-density picolitre reactors. Nature. 2005, 437 (7057): 376-380.

    Google Scholar 

  11. Chun J, Kim KY, Lee JH, Choi Y: The analysis of oral microbial communities of wild-type and toll-like receptor 2-deficient mice using a 454 GS FLX Titanium pyrosequencer. BMC Microbiol. 2010, 10: 101-10.1186/1471-2180-10-101.

    Article  Google Scholar 

  12. Tischoff I, Tannapfe A: DNA methylation in hepatocellular carcinoma. World J Gastroenterol. 2008, 14 (11): 1741-1748. 10.3748/wjg.14.1741.

    Article  Google Scholar 

  13. Shen L, Ahuja N, Shen Y, Habib NA, Toyota M, Rashid A, Issa JP: DNA methylation and environmental exposures in human hepatocellular carcinoma. J Natl Cancer Inst. 2002, 94 (10): 755-761.

    Article  Google Scholar 

  14. Datta J, Kutay H, Nasser MW, Nuovo GJ, Wang B, Majumder S, Liu CG, Volinia S, Croce CM, Schmittgen TD, et al: Methylation mediated silencing of MicroRNA-1 gene and its role in hepatocellular carcinogenesis. Cancer Res. 2008, 68 (13): 5049-5058. 10.1158/0008-5472.CAN-07-6655.

    Article  Google Scholar 

  15. Lee S, Lee HJ, Kim JH, Lee HS, Jang JJ, Kang GH: Aberrant CpG island hypermethylation along multistep hepatocarcinogenesis. Am J Pathol. 2003, 163 (4): 1371-1378.

    Article  Google Scholar 

  16. Zhang C, Guo X, Jiang G, Zhang L, Yang Y, Shen F, Wu M, Wei L: CpG island methylator phenotype association with upregulated telomerase activity in hepatocellular carcinoma. Int J Cancer. 2008, 123 (5): 998-1004. 10.1002/ijc.23650.

    Article  Google Scholar 

  17. Zhang C, Li Z, Cheng Y, Jia F, Li R, Wu M, Li K, Wei L: CpG island methylator phenotype association with elevated serum alpha-fetoprotein level in hepatocellular carcinoma. Clin Cancer Res. 2007, 13 (3): 944-952. 10.1158/1078-0432.CCR-06-2268.

    Article  Google Scholar 

  18. Okochi O, Hibi K, Sakai M, Inoue S, Takeda S, Kaneko T, Nakao A: Methylation-mediated silencing of SOCS-1 gene in hepatocellular carcinoma derived from cirrhosis. Clin Cancer Res. 2003, 9 (14): 5295-5298.

    Google Scholar 

  19. Irahara N, Nosho K, Baba Y, Shima K, Lindeman NI, Hazra A, Schernhammer ES, Hunter DJ, Fuchs CS, Ogino S: Precision of pyrosequencing assay to measure LINE-1 methylation in colon cancer, normal colonic mucosa, and peripheral blood cells. J Mol Diagn. 2010, 12 (2): 177-183. 10.2353/jmoldx.2010.090106.

    Article  Google Scholar 

  20. Uhlmann K, Brinckmann A, Toliat MR, Ritter H, Nurnberg P: Evaluation of a potential epigenetic biomarker by quantitative methyl-single nucleotide polymorphism analysis. Electrophoresis. 2002, 23 (24): 4072-4079. 10.1002/elps.200290023.

    Article  Google Scholar 

  21. Colella S, Shen L, Baggerly KA, Issa JP, Krahe R: Sensitive and quantitative universal Pyrosequencing methylation analysis of CpG sites. Biotechniques. 2003, 35 (1): 146-150.

    Google Scholar 

  22. Tost J, Dunker J, Gut IG: Analysis and quantification of multiple methylation variable positions in CpG islands by Pyrosequencing. Biotechniques. 2003, 35 (1): 152-156.

    Google Scholar 

  23. Taylor KH, Kramer RS, Davis JW, Guo J, Duff DJ, Xu D, Caldwell CW, Shi H: Ultradeep bisulfite sequencing analysis of DNA methylation patterns in multiple gene promoters by 454 sequencing. Cancer Res. 2007, 67 (18): 8511-8518. 10.1158/0008-5472.CAN-07-1016.

    Article  Google Scholar 

  24. Ordway JM, Budiman MA, Korshunova Y, Maloney RK, Bedell JA, Citek RW, Bacher B, Peterson S, Rohlfing T, Hall J, et al: Identification of novel high-frequency DNA methylation changes in breast cancer. PLoS One. 2007, 2 (12): e1314-10.1371/journal.pone.0001314.

    Article  Google Scholar 

  25. Xie H, Wang M, Bonaldo Mde F, Smith C, Rajaram V, Goldman S, Tomita T, Soares MB: High-throughput sequence-based epigenomic analysis of Alu repeats in human cerebellum. Nucleic Acids Res. 2009, 37 (13): 4331-4340. 10.1093/nar/gkp393.

    Article  Google Scholar 

  26. Cordaux R, Batzer MA: The impact of retrotransposons on human genome evolution. Nat Rev Genet. 2009, 10 (10): 691-703. 10.1038/nrg2640.

    Article  Google Scholar 

  27. Varley KE, Mutch DG, Edmonston TB, Goodfellow PJ, Mitra RD: Intra-tumor heterogeneity of MLH1 promoter methylation revealed by deep single molecule bisulfite sequencing. Nucleic Acids Res. 2009, 37 (14): 4603-4612. 10.1093/nar/gkp457.

    Article  Google Scholar 

  28. Korshunova Y, Maloney RK, Lakey N, Citek RW, Bacher B, Budiman A, Ordway JM, McCombie WR, Leon J, Jeddeloh JA, et al: Massively parallel bisulphite pyrosequencing reveals the molecular complexity of breast cancer-associated cytosine-methylation patterns obtained from tissue and serum DNA. Genome Res. 2008, 18 (1): 19-29. 10.1101/gr.6883307.

    Article  Google Scholar 

  29. Zeschnigk M, Martin M, Betzl G, Kalbe A, Sirsch C, Buiting K, Gross S, Fritzilas E, Frey B, Rahmann S, et al: Massive parallel bisulfite sequencing of CG-rich DNA fragments reveals that methylation of many X-chromosomal CpG islands in female blood DNA is incomplete. Hum Mol Genet. 2009, 18 (8): 1439-1448. 10.1093/hmg/ddp054.

    Article  Google Scholar 

  30. Hodges E, Smith AD, Kendall J, Xuan Z, Ravi K, Rooks M, Zhang MQ, Ye K, Bhattacharjee A, Brizuela L, et al: High definition profiling of mammalian DNA methylation by array capture and single molecule bisulfite sequencing. Genome Res. 2009, 19 (9): 1593-1605. 10.1101/gr.095190.109.

    Article  Google Scholar 

  31. Shendure J, Ji H: Next-generation DNA sequencing. Nat Biotechnol. 2008, 26 (10): 1135-1145. 10.1038/nbt1486.

    Article  Google Scholar 

  32. Kumaki Y, Oda M, Okano M: QUMA: quantification tool for methylation analysis. Nucleic Acids Res. 2008, W170-175. 10.1093/nar/gkn294. 36 Web Server

  33. Weller M, Stupp R, Reifenberger G, Brandes AA, van den Bent MJ, Wick W, Hegi ME: MGMT promoter methylation in malignant gliomas: ready for personalized medicine?. Nat Rev Neurol. 2010, 6 (1): 39-51. 10.1038/nrneurol.2009.197.

    Article  Google Scholar 

  34. Hitchins MP, Ward RL: Constitutional (germline) MLH1 epimutation as an aetiological mechanism for hereditary non-polyposis colorectal cancer. J Med Genet. 2009, 46 (12): 793-802. 10.1136/jmg.2009.068122.

    Article  Google Scholar 

  35. Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986, 1 (8476): 307-310.

    Article  Google Scholar 

Download references


The authors would like to thank Jeanette Poczkaj and Elisa Schipper for expert technical assistance and Tim Keys for carefully copyediting the text.

This work was supported by a grant from the "Deutsche Forschungsgemeinschaft" (SFB/TRR77 "Liver Cancer, project B1)

Author information

Authors and Affiliations


Corresponding author

Correspondence to Ulrich Lehmann.

Additional information

Authors' contributions

UL, AP and HK conceived the study; AP, CA, and BH performed all experiments prior to 454 sequencing; SL established and performed the 454 sequencing under the guidance of SS; AP, CA, and UL analyzed the 454 and the pyrosequencing data; KH performed the statistical analysis; HK selected and evaluated all cases; UL and AP wrote the manuscript with support from HK, BH, and SS. All authors read and approved the final manuscript.

Electronic supplementary material

Additional File 1: Number of reads for all loci in all 10 HCC specimens(XLS 16 KB)


Additional File 2: Relationship between number of reads per sample and amplicon length, secondary structure formation, and GC content. (PPT 117 KB)

Additional File 3: Bland-Altman Plots for all 12 loci separately. (PPT 283 KB)

Additional File 4: Regression analysis for all 12 loci separately. (PPT 428 KB)


Additional File 5: Detailed description of differences between 454 sequencing and conventional pyrosequencing. (DOC 38 KB)


Additional File 6: Example for details obtained only by 454 sequencing: Exact determination of the number of fully methylated alleles. (PPT 59 KB)


Additional File 7: Example for details obtained only by 454 sequencing: "Heterogeneous" methylation patterns versus dichotomous patterns ("fully methylated or fully unmethylated"). (PPT 58 KB)

Additional File 8: HCC specimens under study. (DOC 30 KB)

Additional File 9: Primer sequences. (XLS 32 KB)

Authors’ original submitted files for images

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Potapova, A., Albat, C., Hasemeier, B. et al. Systematic cross-validation of 454 sequencing and pyrosequencing for the exact quantification of DNA methylation patterns with single CpG resolution. BMC Biotechnol 11, 6 (2011).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: