J Gen Virol Try IJSEM Online
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


J Gen Virol 88 (2007), 123-133; DOI 10.1099/vir.0.82277-0

This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Supplementary tables and figure
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Jiménez-Hernández, N.
Right arrow Articles by Moya, A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Jiménez-Hernández, N.
Right arrow Articles by Moya, A.
Agricola
Right arrow Articles by Jiménez-Hernández, N.
Right arrow Articles by Moya, A.
© 2007 Society for General Microbiology

Epidemic dynamics of two coexisting hepatitis C virus subtypes

Nuria Jiménez-Hernández1, Manuela Torres-Puente1, Maria Alma Bracho1, Inmaculada García-Robles1, Enrique Ortega2, Juan del Olmo3, Fernando Carnicer4, Fernando González-Candelas1 and Andrés Moya1

1 Instituto Cavanilles de Biodiversidad y Biología Evolutiva and Departamento de Genética, Universidad de Valencia, Spain
2 Unidad de Enfermedades Infecciosas, Hospital General de Valencia, Spain
3 Servicio de Medicina Interna, Hospital Clínico de Valencia, Spain
4 Unidad de Hepatología, Hospital General de Alicante, Spain

Correspondence
Andrés Moya
andres.moya{at}uv.es


   ABSTRACT
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
Hepatitis C virus (HCV) infection affects about 3 % of the human population. Phylogenetic analyses have grouped its variants into six major genotypes, which have a star-like distribution and several minor subtypes. The most abundant genotype in Europe is the so-called genotype 1, with two prevalent subtypes, 1a and 1b. In order to explain the higher prevalence of subtype 1b over 1a, a large-scale sequence analysis (100 virus clones) has been carried out over 25 patients of both subtypes in two regions of the HCV genome: one comprising hypervariable region 1 and another including the interferon sensitivity-determining region. Neither polymorphism analysis nor molecular variance analysis (attending to intra- and intersubtype differences, age, sex and previous history of antiviral treatment) was able to show any particular difference between subtypes that might account for their different prevalence. Only the demographic history of the populations carrying both subtypes and analysis of molecular variance (AMOVA) for risk practice suggested that the route of transmission may be the most important factor to explain the observed difference.

The GenBank/EMBL/DDBJ accession numbers determined in this study are AM271041–AM275326 and AM279768–AM282548 for regions E1–E2 and NS5A, respectively.

Supplementary material is available in JGV Online.


   INTRODUCTION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
Hepatitis C virus (HCV) is the only species of the genus Hepacivirus within the family Flaviviridae. It possesses a positive-sense, single-stranded RNA genome of about 9600 nt, characterized by a high level of heterogeneously distributed genetic variability. Six phylogenetically well-defined clusters, denoted genotypes, and about 50 subtypes have been defined (Simmonds et al., 1993Down; Simmonds, 2004Down). Although they share most basic biological features, there seem to be some differences in persistence and interaction with the host cell among the different HCV genotypes, with important consequences for future therapy and public-health measures (Simmonds, 2004Down). The prevalence of HCV infection has increased in recent decades as a consequence of its incorporation into efficient transmission networks, such as blood transfusion and, most notably, injection-drug usage (IDU) (Pybus et al., 2005Down; Thomson & Finch, 2005Down). As a consequence, the distribution of subtypes and genotypes has gone through, and is still undergoing, dramatic changes. The relative frequencies of HCV genotypes in different populations are not uniform, reflecting changes in population groups, age at time of infection and route of transmission. In industrialized nations, subtype 1a is generally found in younger individuals, sharing IDU being the main risk factor. In contrast, subtype 1b is common in older individuals with a history of blood transfusion (Pybus et al., 2005Down). After the development of more efficient methods for blood screening, new cases of HCV infection due to blood transfusion have fallen dramatically and the relative frequency of genotypes 1b and 2 compared with that of other genotypes is decreasing (Webster et al., 2000Down; Payan et al., 2005Down). This is possibly a reflection of changing modes of infection over the last 30 years and the background prevalence of different genotypes among different age cohorts.

In Spain, the prevalence of HCV is similar to that in other industrialized nations (Wasley & Alter, 2000Down; Domínguez et al., 2001Down), although the distribution of HCV genotypes presents some differences with respect to other European countries (López-Labrador et al., 1997Down). Several studies (Forns et al., 1996Down; López-Labrador et al., 1997Down) have reported a high incidence (up to 86 %) of subtype 1b in Spain, but more recent surveys (Ramos-Sánchez et al., 2003Down; Moreno Planas et al., 2005Down) have documented an increase of subtype 1a (up to 23.7 % in a cohort of 355 individuals), probably reflecting the high incidence (about 86 %) of HCV seropositivity among Spanish injection-drug users (Bolumar et al., 1996Down; Santana Rodríguez et al., 1998Down).

The application of population genetics and evolutionary epidemiology to the analysis of virus genetic variability has proved to have many potential benefits and uses (Moya et al., 2004Down). Among these, the application of coalescence theory (Kingman, 1982Down; Hudson, 1991Down) to the epidemiology of HCV (Pybus et al., 2001Down, 2003Down, 2005Down) has enabled the reconstruction of the epidemic and demographic history of a population from a sample of contemporary gene sequences. These studies have already provided some insight into the evolution of different HCV genotypes on different scales, from worldwide (Pybus et al., 2001Down) to national (Tanaka et al., 2002Down, 2004Down; Pybus et al., 2003Down; Nakano et al., 2004Down), or in specific risk groups (Pybus et al., 2005Down). Interestingly, apart from differences among virus genotypes and virus genome regions being analysed, these studies have also revealed important differences among the different reference populations considered (Nakano et al., 2004Down).

Knowledge of the processes and patterns that drive the epidemiology and evolution of different virus types also permits more sound inferences on their short- and medium-term future evolution and, in the case of HCV infection, this may have important consequences for public-health policies (Tanaka et al., 2002Down). As HCV subtype 1b seems to be associated with advanced liver disease in Spain (López-Labrador et al., 1997Down) and both subtypes 1a and 1b belong to the HCV group with the worst response to antiviral treatment, it is very interesting to characterize and compare the epidemic and evolutionary behaviour of these two genotypes in Spanish populations. This was the main goal of this study, for which we have used information from a large sequence dataset derived in the context of analysing the relationship between virus genetic variability and response to alpha interferon (IFN-{alpha}) plus ribavirin therapy. Twenty-five patients carrying each virus genotype were enrolled in this study and two genome regions were analysed extensively by clone sequencing. The genetic variability and epidemic dynamics of the two virus genotypes were compared after different molecular population-genetics methods were applied to the derived sequences.


   METHODS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
Samples.
Serum samples from 50 HCV-infected patients were chosen for this study; 25 patients were infected with HCV-1b and 25 with HCV-1a.

HCV genotyping was initially performed by a commercial reverse-hybridization genotyping assay (Inno-LIPA HCV II; Innogenetics) and later confirmed by nucleotide sequence comparison in the E1–E2 and NS5A genome regions.

Serum samples were obtained before the patients were subjected to treatment with IFN-{alpha} plus rivabirin. Some patients had been treated previously with IFN, but they did not respond to treatment. Samples were obtained in different hospitals from the Comunidad Valenciana, Spain (see Supplementary Tables S1 and S2, available in JGV Online). Two HCV genome regions were studied: one corresponding to a 472 nt fragment encompassing the genes encoding proteins E1 and E2 (from nt 1310 to 1481 in the reference HCV genome sequence; GenBank accession no. D50481 [GenBank] ) including hypervariable region 1 (HVR1), referred to as the E1–E2 region, and the other corresponding to a 743 nt fragment from gene NS5A (nt 6742–7484) including the IFN sensitivity-determining region (ISDR), referred to as the NS5A region. Two criteria were followed to select these regions: (i) differences in evolutionary rate and (ii) structural motifs related to immunity and/or antiviral treatment. Evolution in the two regions is known to occur at different rates, being faster in E1–E2.

Virus RNA extraction and amplification.
Virus RNA was extracted from 140 µl serum by using a High Pure Viral RNA kit (Roche). In order to prevent any bias during reverse-transcription reactions due to unspecific oligonucleotides, these reactions were performed with random hexadeoxynucleotides. Reverse transcriptions were performed in a 20 µl volume containing 5 µl eluted RNA, 4 µl 5x RT buffer, 0.5 mM each deoxynucleotide, 0.5 µg random hexamers, 100 U Moloney murine leukaemia virus reverse transcriptase (Promega) and 20 U RNasin RNase inhibitor (Promega). The reactions were incubated at 42 °C for 45 min, followed by 3 min at 95 °C.

A first round of PCR was then carried out in a 100 µl volume containing 10 µl of the reverse transcription product, 0.2 mM each dNTP, 400 nM genomic primer, 400 nM antigenomic primer and 1.25 U Pfu DNA polymerase (Promega). The primers used, detailed in Table 1Down of Bracho et al. (2004)Down unless specified below, were: for region E1–E2, subtype 1a: 1-Eg1, 1-Eg2 and 1-Ea; and for subtype 1b: 2-Eg1, 2-Eg2 and 2-Ea; for region NS5A, subtype 1a: 1-Ng1, 2-Ng1, 1-Ng2, 2-Ng2, 1-Na and 2-Na. Primers for region NS5A, subtype 1b were Ng1 (5'-TGGAYGGRGTRCGGYTGCACAGGTA), Ng2 (5'-CAGGTACGCTCCRGYRTGCA) and Na (5'-CCYTCRAGGGGGGGCAT). In all cases, PCR was performed in a thermal cycler (Perkin Elmer 2400) as described previously (Bracho et al., 2004Down).


View this table:
[in this window]
[in a new window]

 
Table 1. Summary of genetic-variability parameter estimates

S, No. polymorphic sites; Eta, minimum no. mutations; Nhap, no. haplotypes; HD, haplotype diversity; Pi, nucleotide polymorphism; Theta(S), effective population mutation rate from S; k, mean pairwise differences for each genome region and virus subtype; SD, standard deviation; Max, maximum; Min, minimum.

 
Cloning and sequencing of virus populations.
Amplified DNA products for each region were purified and cloned directly into EcoRV-digested pBluescript II SK(+) phagemid (Stratagene). Cloned products for the E1–E2 region or NS5A region were sequenced by using vector-based primers KS and SK (Stratagene). For the former region, we obtained about 100 clones from each patient, yielding a total of 5060 sequences. For the NS5A region, we obtained between 25 and 96 clones per patient, and 3176 sequences in total were determined (see Supplementary Tables S3–S6, available in JGV Online).

Sequencing was carried out by using the ABI PRISM BigDye Terminator v3.0 system (Applied Biosystems) on an ABI 3700 automated sequencer. Sequences were verified and both strands were assembled by using the STADEN package (Staden et al., 2000Down). HCV sequences obtained in this study have been deposited in GenBank with accession nos AM271041–AM275326 and AM279768–AM282548 for regions E1–E2 and NS5A, respectively.

Sequence and polymorphism analysis.
Sequence alignments were obtained by using CLUSTAL_X v1.81 (Thompson et al., 1997Down). Several parameter estimates of DNA polymorphism were obtained with DnaSP 4.0 (Rozas et al., 2003Down). The following measures of genetic variability were estimated for virus samples of each patient: total number of mutations, number of segregating sites, haplotype and nucleotide diversity and number of paired nucleotide differences. The mean value and SEM for each subtype and region were calculated. Differences were tested by means of t-tests when data followed a normal distribution or, as in the case of haplotype diversity, by means of a non-parametric Mann–Whitney U-test. Additionally, genetic-diversity (intrapatient) and -differentiation (between patients) estimates were obtained by using MEGA 3.1 (Kumar et al., 2004Down).

AMOVA.
To investigate further the effect of different factors on the partitioning of genetic variation, hierarchical AMOVAs were performed by using ARLEQUIN v2.0 (Schneider et al., 2000Down). Total variance was partitioned among groups, among patients within groups and within patients. The variance components were used to compute fixation indices (Wright, 1951Down, 1965Down; Slatkin, 1991Down) and statistical significance was tested by means of a non-parametric permutation approach (based on 3000 replicates) as described by Excoffier et al. (1992)Down. Groups were defined according to the following factors: intersubtype differences, age, sex, risk factor and IFN treatment before the samples were collected.

Estimation of epidemic dynamics.
The demographic history of these virus genotypes in this population was estimated by using parametric and non-parametric methods, based on coalescent theory (Griffiths & Tavaré, 1994Down), for each of the four gene/genotype combinations studied. As this approach is heavily demanding on computational resources, it was necessary to select a subset of the total number of sequenced clones to obtain results in a reasonable time. We used the following three subsets: (i) one random sequence clone obtained from each patient, for a total of 25 sequences for each subtype and genome region; (ii) the same total number of sequences, but now using the ‘consensus' sequence from each patient; and (iii) the two most genetically divergent sequences among those obtained from each patient, thus representing 50 sequences per subtype and genome region.

The estimation procedure involved several steps (Pybus et al., 2005Down). Once the sequences were aligned, MODELTEST 3.1 (Posada & Crandall, 1998Down) and PAUP* 4.0b10 (Swofford, 2001Down) were used to derive the evolutionary-substitution model that best explained the data according to the Akaike information criterion (Akaike, 1974Down). A maximum-likelihood (ML) tree was obtained by using the best evolutionary model and with the molecular clock enforced. To convert the estimated genealogy into a timescale of years, we used the estimated evolutionary rates in the two genome regions from a set of sequences obtained from serially sampled patients (M. Torres-Puente, N. Jiménez, M. A. Bracho, I. García-Robles, F. Carnicer, J. del Olmo, E. Ortega, A. Moya & F. González-Candelas, unpublished data), using the procedure implemented in TipDate (Rambaut, 2000Down). Briefly, HCV isolates from nine non-responder patients (three of whom were also included in this report: A09 and G14, of subtype 1a, and C08 of subtype 1b) were determined to evolve according to a molecular clock in both genome regions when clones from two time points – before and after IFN plus ribavirin treatment, about 6 months apart – were compared. Finally, the epidemic history and the demographic parameters were estimated from the corresponding time-corrected genealogies. This estimation was performed with the program GENIE 3.0 (Pybus & Rambaut, 2002Down). For more details of this method, see Holmes et al. (1995)Down, Pybus et al. (2000Down, 2005)Down and Pybus & Rambaut (2002)Down.

Basic reproductive number: R0.
This parameter and its confidence interval were derived from GENIE. R0 is defined as the mean number of secondary infections derived from an infected individual in a completely susceptible population. Only when R0>1 can infection spread over the population. Following Pybus et al. (2001)Down, R0=rD+1, where r, the rate of exponential population growth, is estimated from the population-growth model obtained from GENIE and D is an empirical value of the mean duration of infectiousness. For HCV, we have considered two values for D: 15 and 25 years.


   RESULTS
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
Polymorphism and differentiation analyses
Genetic variability in the virus sequences obtained from each patient was estimated with different measures of polymorphism (see Supplementary Tables S3–S6, available in JGV Online). Mean values and SEM for the different parameter estimates by genome region and genotype are summarized in Table 1Up and compared in Fig. 1Down. Genotype 1b was systematically more polymorphic than genotype 1a for all measures of polymorphism, with the exception of haplotype diversity, where the mean value in the E1–E2 region for subtype 1a was slightly higher than that for subtype 1b, although with no statistical significance. This result is due to a single patient (C13) who harbours two quite different population sequences in the NS5A region. These populations are very divergent and one of them is characterized by a 9 bp insertion, apart from differences in many other sites. As this individual belongs to the donor/transfusion category, this difference presented statistical significance when comparisons were performed for different risks factors (see below). In contrast to the E1–E2 region, the differences were always statistically significant (P<0.05) for the NS5A region (Fig. 1Down).


Figure 1
View larger version (16K):
[in this window]
[in a new window]

 
Fig. 1. Graphic representation of the mean values and SEM for several parameters of genetic variation, for both subtypes and regions. Asterisks indicate statistically significant differences between subtypes.

 
A common feature for both regions and virus subtypes is the extraordinary heterogeneity observed for the different parameters estimated within every group. In each of these, some patients harboured highly variable virus populations, with parameters close to or even equal to the maximum possible value for the analysed sample, whereas others presented almost completely monomorphic populations. This pattern leads to large variances in the estimates of the different parameters and, in consequence, to very conservative tests for pairwise comparisons between groups. A possible solution to obtain a more realistic picture of the different underlying parameters is to compare the medians instead of the means (Table 1Up). This comparison again results in the same general conclusions already discussed.

Despite the high heterogeneity in genetic variability within patients, most genetic variation is found at the interpatient level (Table 2Down; Supplementary Tables S7–S10 and Supplementary Fig. S1, available in JGV Online). This pattern is consistent for both genome regions and virus subtypes, with about 85 % of the total genetic variation being found among patients. Nevertheless, there are several cases in which genetic differentiation between patients was lower than genetic diversity within patients. So, for subtype 1a, the pairwise differences for patients C14, C17 and C38 are lower than several intrapatient diversities for both the E1–E2 and NS5A regions. These three patients were known to be related epidemiologically, as they were infected from a common source in a recent, large HCV outbreak (F. González-Candelas, M. A. Bracho, B. Wróbel & A. Moya, unpublished data). In contrast, four HCV-1b-infected patients (A14, A35, C10 and C19) presented lower interpatient divergence in the NS5A region than several intrapatient diversities, but this was not the case for the E1–E2 region, although the interpatient diversities for these patients in this region were among the lowest (see Supplementary Table S8, available in JGV Online). Three of these patients (A14, A35 and C10) had unknown risk factors for HCV infection (see Supplementary Table S2) and the fourth presumably became infected through IDU. Hence, a possible relationship among these patients (including also patient C15) cannot be ruled out. If it does exist, it is reflected only on a slowly evolving region of the genome, in which changes have not yet accumulated to such an extent as to delete every footprint of their common origin.


View this table:
[in this window]
[in a new window]

 
Table 2. Summary of genetic-diversity estimates in the E1–E2 and NS5A regions for each subtype

 
A more appropriate statistical methodology for testing the differential contribution of different factors to this partitioning of molecular variation is provided by AMOVA, which we performed next.

AMOVA
HCV genetic variation was analysed with regard to several factors that might generate significant differences among the groups considered: intersubtype differences, age and sex of the patients, previous treatment with IFN and risk factor for HCV infection.

When considering intersubtype differences, variance was partitioned among and within patients belonging to the same subtype for each genome region. Table 3Down shows the corresponding AMOVAs. As can be observed for both regions, the highest percentage of variation is due to differences among subtypes, followed by differences among patients and within patients.


View this table:
[in this window]
[in a new window]

 
Table 3. AMOVAs for differences among subtypes

d.f., Degrees of freedom.

 
Patients were grouped by age into the five following categories: (i) between 20 and 30 years; (ii) between 31 and 40 years; (iii) between 41 and 50 years; (iv) between 51 and 60 years; and (v) between 61 and 70 years. We defined four groups for risk factor: (i) patients who acquired HCV by IDU; (ii) patients subjected to blood transfusion or blood donors; (iii) patients infected in an epidemic outbreak; and (iv) patients who acquired HCV from an unknown source (community-acquired HCV). For these factors, as well as for sex and previous administration of IFN, the total genetic variance was partitioned hierarchically among factors, among patients within factors and within patients. No significant differences were detected either for subtype or genome region for age (see Supplementary Tables S11 and S12, available in JGV Online), sex (see Supplementary Tables S13 and S14) or previous IFN treatment (see Supplementary Tables S15 and S16). However, significant differences appeared between groups defined by risk practice for genotype 1a in both regions (Table 4Down). These analyses were performed by considering three groups for subtype 1a: IDU, outbreak and of unknown origin, and for subtype 1b: IDU, donor/transfusion and of unknown origin. Similar results (not shown) were obtained when analyses were carried out excluding the ‘unknown-origin’ category, although with a tendency to increase the difference observed due to the effect of the risk factor. The lack of significance in the case of subtype 1b can be explained by the high genetic divergence within patients (see Fig. 1Up), probably resulting from its older presence in this population.


View this table:
[in this window]
[in a new window]

 
Table 4. AMOVAs for the risk groups corresponding to the E1–E2 and NS5A regions

Groups considered for subtype 1a: IDU (A05, A20, A26, C02, C07, C11, C21, C22, C28, G10, G19), outbreak (C14, C17, C38), unknown or community-acquired (A09, A27, C06, C18, C20, C24, C31, C33, G14). Groups for subtype 1b: IDU (C03, C16, C19), transfusion (C09, C13, C25), unknown or community-acquired (A14, C04, C05, C08, C10, C12, C15, G02, G05, G06, G07, G09, G16, G17, G26).

 
Except for the NS5A region in subtype 1b patients, virus sequences from IDU patients were genetically more diverse than those derived from an outbreak (subtype 1a) or from being donors or subjected to transfusion (subtype 1b, see Table 5Down). The exception is due to a single patient (C13, see Supplementary Table S6 in JGV Online) who harbours two quite different population sequences in the NS5A region. These populations are very divergent, resulting in a high value for the nucleotide-diversity estimate within this patient, and one of them is characterized by a 9 bp insertion, apart from differences in many other sites. Hence, as this is a unique event and, on a sample of only three patients in this category, as it has a strong influence on the global mean for this group, we interpret this observation more as an effect of sampling than as a feature to be explained by the kind of transmission (donor/transfusion) common to patients from this group.


View this table:
[in this window]
[in a new window]

 
Table 5. Mean nucleotide diversity (±SD) for the different risk groups

 
Demographic history of subtypes 1a and 1b and the basic reproductive number
We have also investigated the demographic history of both subtypes in order to discern underlying reasons for the higher prevalence of genotype 1b over 1a in this population. Fig. 2Down shows the ML estimates of effective population sizes through time and the corresponding non-parametric estimates (i.e. generalized skyline plots) for both genotypes and genome regions analysed. The graphical representation of the epidemic history is scaled in years. As evolutionary rates, we used the following estimates: 3.33x10–3 and 1.75x10–3 substitutions per site per year for the E1–E2 and NS5A regions, respectively (M. Torres-Puente, N. Jiménez, M. A. Bracho, I. García-Robles, F. Carnicer, J. del Olmo, E. Ortega, A. Moya & F. González-Candelas, unpublished data).


Figure 2
View larger version (15K):
[in this window]
[in a new window]

 
Fig. 2. Coalescence-based estimates of demographic dynamics of HCV subtypes 1a and 1b in the studied population. ML parametric (continuous lines) and non-parametric (skyline plots; dotted lines) estimates are shown for each genome region (upper panel, E1–E2; lower panel, NS5A). The x axes represent time in years; the y axes indicate effective population size.

 
The demographic models with the highest likelihood varied among datasets (Fig. 2Up). The datasets of genotype 1a fitted a model of exponential growth and piecewise demographic expansion in the NS5A and E1–E2 regions, respectively. The latter is a two-phase model of population growth, consisting of an initial period of constant population size followed by a period of exponential growth. The difference in the ML models for both regions is probably a reflection of the different best substitution-rate models. Nevertheless, both models indicated an increase in growth rate and onset of exponential growth during the 1980s. The panorama offered by genotype 1b was different. In this case, we observed that the epidemic-growth rate slowed down over time, reaching a steady state. This behaviour was reflected in a logistic-growth model for both regions (Fig. 2Up). The number of newly infected individuals with this genotype appears to have increased slowly or stalled during the early 1980s. Noticeably, this analysis shows a time overlap in the change of epidemic-growth phase in the two virus genotypes, with an increase in the growth rate of subtype 1a corresponding to the decrease of 1b. It should be indicated that similar results were obtained when the input dataset was not a random sequence for each patient, but the two most divergent or the consensus sequence.

Finally, we have estimated R0, the basic reproductive number, for both subtypes, assuming mean times of infectiousness of 15 and 25 years. Table 6Down shows the estimates of R0, with confidence intervals (except in one case where it was not possible), according to the three applied methods used to sample sequences from patients. As can be observed, firstly, R0 is always >1, and second, when comparing subtypes 1a and 1b, both regions always show the same pattern. However, there is an effect on R0 of the sampling method of sequences from patients, because such a pattern shows the opposite direction when sampling was done on the two most divergent sequences compared with the other two. It is worth noticing, however, that the random sequence or the consensus sequence yields closer estimates. Larger values for R0 were obtained when using D=25 instead of D=15, but the general pattern just described was the same regardless of the time considered for infectiousness.


View this table:
[in this window]
[in a new window]

 
Table 6. Estimates of R0 (with 95 % confidence intervals) for both subtypes and regions according to the three applied methods of sampling sequences from patients

Two times of infectiousness (D=15 and D=25 years) were considered.

 

   DISCUSSION
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
HCV genotypes and subtypes exhibit a complex epidemiological pattern with respect to geographical distribution, prevalence, response to treatment and transmission mode. Ascertaining the factors responsible for such complex epidemiology is a difficult task and, if solved, it can contribute to act on the disease. Although studies (Mondelli & Silini, 1999Down; Zein, 2000Down) have reported that genetic differences between virus subtypes 1a and 1b could account for their prevalence and clinical outcome, there are no conclusive results yet. In this work, we have pursued a similar objective, which we approached by studying the effect of several factors on partitioning the observed genetic variation in both virus subtypes. In addition, we have made use of an analytical tool based on coalescent theory (Pybus et al., 2000Down; Strimmer & Pybus, 2001Down) to make inferences on the epidemic history of both HCV subtypes.

Subtype 1b is more polymorphic than 1a (Fig. 1Up) in our population, and also when it is grouped into smaller groups according to risk factor (Table 4Up). This observation has been also reported elsewhere (Tanaka et al., 2002Down; Simmonds, 2004Down). Our results indicate that this might be due to subtype 1b being established in this population for far longer than subtype 1a.

The E1–E2 region is more polymorphic than NS5A and the different measures of genetic polymorphism used showed statistically significant differences between both subtypes for region NS5A, but not for E1–E2. It seems that selective constraints are acting differentially on both regions (unpublished data). The samples used in this analysis are a subset of those used in a larger study on the effects of IFN and ribavirin treatment on the patients' response and virus genetic variation. The two genome regions analysed in this study were chosen because they seem to be associated with the virus response to treatment. So, the NS5A gene contains the ISDR and the E1–E2 gene fragment analysed encompasses HVR1 and HVR2, which might account for their different evolutionary behaviour. Although it is usually the NS5B gene that has been used for HCV genotyping and molecular-epidemiology studies, the epidemic dynamics analysed here should be reflected similarly throughout the whole HCV genome, provided that the region under analysis accumulates enough differences in the time interval considered. This is the case for both regions, although their different evolutionary rates and possibly different selective regimes translate into the reported differences.

The results obtained with respect to the demographic history support the hypothesis that the differences in prevalence between subtypes could be due to differences in the route of transmission, which also correlate with the frequency of such routes through time (Mortimer, 1995Down; Smith et al., 1997Down; Webster et al., 2000Down; Zein, 2000Down). These studies have established a relationship between route of transmission and virus genotypes and subtypes. Specifically, it has been shown that genotype 1a is associated preferentially with young intravenous-drug users; meanwhile, genotype 1b is more abundant in people over 50 years of age and commonly associated with blood transfusion and sporadic hepatitis (Pawlotsky et al., 1995Down; Pol et al., 1995Down; Simmonds et al., 1996Down). Accordingly, and with an argument similar to that used previously for other populations (Kalinina et al., 2001Down; Yu et al., 2001Down), we could hypothesize a change in prevalence of subtype 1a over 1b in the near future in this Spanish population, with corresponding changes in the incidence of disease complications associated differentially with the subtypes (Tanaka et al., 2002Down).

Hepatitis C is a young disease for science, as its causative agent was unknown until 1989 (Choo et al., 1989Down). For this reason, until then, no methods were available to screen blood successfully for HCV and to implement other measures to prevent its infectious spread. Around the early 1980s, the existence of a nonA–nonB hepatitis virus was known and there were also a few methods to prevent virus transmission by contaminated blood products, which diminished the incidence of subtype 1b slightly until the discovery of the virus in 1989 (Memon & Memon, 2002Down). After its discovery, new cases of infection due to blood transfusion have fallen dramatically (Donahue et al., 1992Down), which would explain both the growth-rate stabilization of subtype 1b and its higher prevalence in patients over 50 years of age.

The demographic dynamics shown in Fig. 2Up indicate that subtype 1b epidemics appeared before those of 1a. The population dynamics inferred from coalescent theory for subtype 1b are typical of a logistic growth, with an initial phase of unknown duration of slow growth, followed by a well-defined phase of exponential growth and, finally, a steady state. Analysis of subtype 1a reveals a similar pattern, but with a time lag of several decades. The exponential-growth phase of subtype 1a started a few years after subtype 1b reached its stationary phase. This is an independent indication that the dynamics of both subtypes have been largely independent from each other, as they share neither the main route of transmission nor the infected population. Consequently, we would expect that subtype 1b was more prevalent than 1a a few years ago, a situation likely to change soon. Several reports from Spanish populations provide empirical support for this prediction from our sequence-based analysis (Forns et al., 1996Down; López-Labrador et al., 1997Down; Ramos-Sánchez et al., 2003Down; Moreno Planas et al., 2005Down).

This demographic pattern also predicts a change in prevalence according to age. This is precisely what we have observed. In the range of 20–30 years of age, 38.5 % of patients were infected with subtype 1b, meanwhile 61.5 % were infected with 1a; in the range of 30–40 years of age, 41.2 % were infected with 1b and 58.8 % with 1a; in the range of 41–50 years of age, 69.2 % were infected with 1b and 30.8 % with 1a; in the range of 51–60 years of age, 86.6 % were infected with 1b and 13.4 % with 1a; and finally, in the range of 60–70 years of age, 100 % were infected with 1b. Why has subtype 1b changed its growth dynamics? It is known that IDU has risen during recent years and a proportionately high number of newly infected patients acquired HCV through this route (Pawlotsky et al., 1995Down; Webster et al., 2000Down). Due to the methods for HCV screening in blood, infection through transfusions or blood donations is very difficult and, for this reason, it is expected that, from 1989 onwards, most new cases of infection of HCV are associated preferentially with IDU and other uncontrolled routes involving contaminated instruments or blood. This pattern accounts well for the recent increase in the growth rate found in the demographic history of subtype 1a, the higher prevalence among younger people and the decrease in growth rate for 1b. The temporal coincidence in the rise of subtype 1a seems to be related more directly to the increase of IDU in Western countries rather than to a competitive displacement of the previous prevalent subtype, HCV-1b, by a new variant with higher fitness.

Further support for this hypothesis derives from the AMOVA results on risk factor and the estimates of R0 presented here. Risk factors affect subtypes 1a and 1b differentially (Table 4Up), where there is a higher divergence between IDU patients of subtype 1a with respect to the rest of the groups than between those of subtype 1b against their corresponding groups, which is in favour of a preferential transmission of 1a through IDU. Our estimates of R0, the basic reproductive number, are in all cases >1 (Table 6Up). This indicates that the epidemics will take off in both subtypes. However, there are disparities in the estimates of R0 according to the sampling of sequences from patients, something that merits comment. When considering the consensus sequence or a sequence taken randomly, first, both estimates are similar for each subtype and genome region and, second, they point to a future imposition of subtype 1a over 1b. The result was completely the opposite when sampling was done by using the two most divergent sequences from each patient. In addition, the estimates are the most divergent among the three methods. This observation, together with evidence presented in this work favouring the exponential expansion of subtype 1a and stability of 1b, casts some doubts about the validity of sampling the two most divergent sequences. A higher R0 value for subtype 1a is expected if we consider that effective measures to control IDU are lower than those applied to control HCV among donors or in transfusions, which also supports the replacement of subtype 1b by 1a.

Finally, we have used our own estimates for the evolutionary rates in the two regions analysed. The main reason is that these estimates were obtained from a sample of patients that partially overlapped those used in this analysis and for exactly the same genome regions considered here. None of the previously available estimates (Abe et al., 1992Down; Smith et al., 1997Down; Pybus et al., 2001Down; Cochrane & Simmonds, 2002Down) matched the limits used in this case exactly. This may contribute to explaining the difference in the values obtained in our estimates from those of other authors, whose estimates range between 0.7x10–3 and 1.92x10–3 for the E1–E2 genes and between 0.4x10–3 and 0.5x10–3 for the NS5 gene. There are, however, some other points to be considered. Firstly, even though we chose for the estimation procedure only a reduced subset of patients in whom the molecular clock could not be rejected in either of the two regions considered, we obtained highly variable estimates for the different patients, especially in the E1–E2 region, with differences of up to three orders of magnitude. This extraordinary variability is also reflected in the range of values for different parameter estimates of genetic polymorphism (Table 1Up; Supplementary Tables S3 and S4, available in JGV Online), although in this case, the time since each patient was infected before sampling certainly contributes to the differences observed. In consequence, it is very adventurous to assign a single rate of evolution to an organism such as HCV, which can exhibit such a wide variation depending on the niche (i.e. patient) that it colonizes. Secondly, our estimates were based on the analysis of changes accumulated over a relatively short time period, 6 months, as opposed to most other estimates in which the time involved has been usually measured in years. There is a well-known inverse relationship between evolutionary rate and time of evolution (Holmes, 2003Down) and it is not clear which estimates should be used in specific contexts, such as the reconstruction of epidemic behaviour, because although the period covered may expand for decades or even hundreds of years in the case of HCV, the actual sequences used in the analysis display a range of divergences, from months to years. In any case, our translation of the epidemic history into absolute time by using our own evolutionary rates matches very closely what is known about the recent epidemiology of these two HCV subtypes in the reference population.


   ACKNOWLEDGEMENTS
 
This work was supported by Conselleria de Sanitat i Consum, Generalitat Valenciana (Spain) and project BFU2005-00503 from Ministerio de Educación y Ciencia (Spain).


   REFERENCES
TOP
ABSTRACT
INTRODUCTION
METHODS
RESULTS
DISCUSSION
REFERENCES
 
Abe, K., Inchauspe, G. & Fujisawa, K. (1992). Genomic characterization and mutation rate of hepatitis C virus isolated from a patient who contracted hepatitis during an epidemic of non-A, non-B hepatitis in Japan. J Gen Virol 73, 2725–2729.[Abstract/Free Full Text]

Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans Autom Control 19, 716–723.[CrossRef]

Bolumar, F., Hernández-Aguado, I., Ferrer, L., Ruiz, I., Avino, M. J. & Rebagliato, M. (1996). Prevalence of antibiotics to hepatitis C in a population of intravenous drug users in Valencia, Spain, 1990–1992. Int J Epidemiol 25, 204–209.[Abstract/Free Full Text]

Bracho, M. A., García-Robles, I., Jiménez, N., Torres-Puente, M., Moya, A. & González-Candelas, F. (2004). Effect of oligonucleotide primers in determining viral variability within hosts. Virol J 1, 13.[CrossRef][Medline]

Choo, Q. L., Kuo, G., Weiner, A. J., Overby, L. R., Bradley, D. W. & Houghton, M. (1989). Isolation of a cDNA clone derived from a blood-borne non-A, non-B viral hepatitis genome. Science 244, 359–362.[Abstract/Free Full Text]

Cochrane, A. & Simmonds, P. (2002). Molecular epidemiology of hepatitis C virus. In The Molecular Epidemiology of Human Viruses, pp. 197–216. Edited by T. Leiner. Dordrecht: Kluwer Acadademic.

Domínguez, A., Bruguera, M., Vidal, J., Plans, P. & Salleras, L. (2001). Community-based seroepidemiological survey of HCV infection in Catalonia, Spain. J Med Virol 65, 688–693.[CrossRef][Medline]

Donahue, J. G., Muñoz, A., Ness, P. M., Brown, D. E., Jr, Yawn, D. H., McAllister, H. A., Jr, Reitz, B. A. & Nelson, K. E. (1992). The declining risk of post-transfusion hepatitis C virus infection. N Engl J Med 327, 369–373.[Abstract]

Excoffier, L., Smouse, P. E. & Quattro, J. M. (1992). Analysis of molecular variance inferred from metric distances among DNA haplotypes: application to human mitochondrial DNA restriction data. Genetics 131, 479–491.[Abstract]

Forns, X., Maluenda, M. D., López-Labrador, F. X., Ampurdanes, S., Olmedo, E., Costa, J., Simmonds, P., Sanchez-Tapias, J. M., Jimenez De Anta, M. T. & Rodes, J. (1996). Comparative study of three methods for genotyping hepatitis C virus strains in samples from Spanish patients. J Clin Microbiol 34, 2516–2521.[Abstract]

Griffiths, R. C. & Tavaré, S. (1994). Sampling theory for neutral alleles in a varying environment. Philos Trans R Soc Lond B Biol Sci 344, 403–410.[Medline]

Holmes, E. C. (2003). Molecular clocks and the puzzle of RNA virus origins. J Virol 77, 3893–3897.[Free Full Text]

Holmes, E. C., Nee, S., Rambaut, A., Garnett, G. P. & Harvey, P. H. (1995). Revealing the history of infectious disease epidemics through phylogenetic trees. Philos Trans R Soc Lond B Biol Sci 349, 33–40.[Medline]

Hudson, R. R. (1991). Gene genealogies and the coalescent process. Oxford Surv Evol Biol 7, 1–44.

Kalinina, O., Norder, H., Vetrov, T., Zhdanov, K., Barzunova, M., Plotnikova, V., Mukomolov, S. & Magnius, L. O. (2001). Shift in predominating subtype of HCV from 1b to 3a in St Petersburg mediated by increase in injecting drug use. J Med Virol 65, 517–524.[CrossRef][Medline]

Kingman, J. F. C. (1982). On the genealogy of large populations. J Appl Probab 19, 27–43.

Kumar, S., Tamura, K. & Nei, M. (2004). MEGA3: integrated software for Molecular Evolutionary Genetics Analysis and sequence alignment. Brief Bioinform 5, 150–163.[Abstract/Free Full Text]

López-Labrador, F. X., Ampurdanés, S., Forns, X., Castells, A., Saiz, J. C., Costa, J., Bruix, J., Sanchez Tapias, J. M., Jimenez de Anta, M. T. & Rodes, J. (1997). Hepatitis C virus (HCV) genotypes in Spanish patients with HCV infection: relationship between HCV genotype 1b, cirrhosis and hepatocellular carcinoma. J Hepatol 27, 959–965.[CrossRef][Medline]

Memon, M. I. & Memon, M. A. (2002). Hepatitis C: an epidemiological review. J Viral Hepat 9, 84–100.[CrossRef][Medline]

Mondelli, M. U. & Silini, E. (1999). Clinical significance of hepatitis C virus genotypes. J Hepatol 31 (Suppl. 1), 65–70.

Moreno Planas, J. M., Fernández Ruiz, M., Portero Azorín, F., Boullosa Grana, E., Rubio Gonzalez, E., Martin Garcia, S., Martinez Arrieta, F., Jimenez Garrido, M., Sanchez Turrion, V. & Cuervas-Mons Martinez, V. (2005). Prevalence of hepatitis C virus genotypes in a Spanish liver transplant unit. Transplant Proc 37, 1486–1487.[CrossRef][Medline]

Mortimer, P. P. (1995). Arsphenamine jaundice and the recognition of instrument-borne virus infection. Genitourin Med 71, 109–119.[Medline]

Moya, A., Holmes, E. C. & González-Candelas, F. (2004). The population genetics and evolutionary epidemiology of RNA viruses. Nat Rev Microbiol 2, 279–288.[CrossRef][Medline]

Nakano, T., Lu, L., Liu, P. & Pybus, O. G. (2004). Viral gene sequences reveal the variable history of hepatitis C virus infection among countries. J Infect Dis 190, 1098–1108.[CrossRef][Medline]

Pawlotsky, J. M., Tsakiris, L., Roudot-Thoraval, F., Pellet, C., Stuyver, L., Duval, J. & Dhumeaux, D. (1995). Relationship between hepatitis C virus genotypes and sources of infection in patients with chronic hepatitis C. J Infect Dis 171, 1607–1610.[Medline]

Payan, C., Roudot-Thoraval, F., Marcellin, P., Bled, N., Duverlie, G., Fouchard-Hubert, I., Trimoulet, P., Couzigou, P., Cointe, D. & other authors (2005). Changing of hepatitis C virus genotype patterns in France at the beginning of the third millenium: the GEMHEP GenoCII Study. J Viral Hepat 12, 405–413.[CrossRef][Medline]

Pol, S., Thiers, V., Nousbaum, J. B., Legendre, C., Berthelot, P., Kreis, H. & Brechot, C. (1995). The changing relative prevalence of hepatitis C virus genotypes: evidence in hemodialyzed patients and kidney recipients. Gastroenterology 108, 581–583.[CrossRef][Medline]

Posada, D. & Crandall, K. A. (1998). MODELTEST: testing the model of DNA substitution. Bioinformatics 14, 817–818.[Abstract/Free Full Text]

Pybus, O. G. & Rambaut, A. (2002). GENIE: estimating demographic history from molecular phylogenies. Bioinformatics 18, 1404–1405.[Abstract/Free Full Text]

Pybus, O. G., Rambaut, A. & Harvey, P. H. (2000). An integrated framework for the inference of viral population history from reconstructed genealogies. Genetics 155, 1429–1437.[Abstract/Free Full Text]

Pybus, O. G., Charleston, M. A., Gupta, S., Rambaut, A., Holmes, E. C. & Harvey, P. H. (2001). The epidemic behavior of the hepatitis C virus. Science 292, 2323–2325.[Abstract/Free Full Text]

Pybus, O. G., Drummond, A. J., Nakano, T., Robertson, B. H. & Rambaut, A. (2003). The epidemiology and iatrogenic transmission of hepatitis C virus in Egypt: a Bayesian coalescent approach. Mol Biol Evol 20, 381–387.[Abstract/Free Full Text]

Pybus, O. G., Cochrane, A., Holmes, E. C. & Simmonds, P. (2005). The hepatitis C virus epidemic among injecting drug users. Infect Genet Evol 5, 131–139.[CrossRef][Medline]

Rambaut, A. (2000). Estimating the rate of molecular evolution: incorporating non-contemporaneous sequences into maximum likelihood phylogenies. Bioinformatics 16, 395–399.[Abstract/Free Full Text]

Ramos-Sánchez, M. C., Torio-Cabezón, R., Mazón-Ramos, M. A., Martín-Gil, F. J. & del Alamo, M. (2003). Hepatitis C virus genotype 4 in a North-west Spain district. J Clin Virol 28, 223–224.[CrossRef][Medline]

Rozas, J., Sánchez-del Barrio, J. C., Messeguer, X. & Rozas, R. (2003). DnaSP, DNA polymorphism analyses by the coalescent and other methods. Bioinformatics 19, 2496–2497.[Abstract/Free Full Text]

Santana Rodríguez, O. E., Male Gil, M. L., Hernández Santana, J. F., Liminana Canal, J. M. & Martín Sánchez, A. M. (1998). Prevalence of serologic markers of HBV, HDV, HCV and HIV in non-injection drug users compared to injection drug users in Gran Canaria, Spain. Eur J Epidemiol 14, 555–561.[CrossRef][Medline]

Schneider, S., Roessli, D. & Excoffier, L. (2000). ARLEQUIN version 2000: a software for population genetic data analysis. Genetics and Biometry Laboratory. University of Geneva, Switzerland.

Simmonds, P. (2004). Genetic diversity and evolution of hepatitis C virus – 15 years on. J Gen Virol 85, 3173–3188.[Abstract/Free Full Text]

Simmonds, P., Holmes, E. C., Cha, T. A., Chan, S. W., McOmish, F., Irvine, B., Beall, E., Yap, P. L., Kolberg, J. & Urdea, M. S. (1993). Classification of hepatitis C virus into six major genotypes and a series of subtypes by phylogenetic analysis of the NS-5 region. J Gen Virol 74, 2391–2399.[Abstract/Free Full Text]

Simmonds, P., Mellor, J., Craxi, A., Sanchez-Tapias, J. M., Alberti, A., Prieto, J., Colombo, M., Rumi, M. G., Lo Iacano, O. & other authors (1996). Epidemiological, clinical and therapeutic associations of hepatitis C types in western European patients. J Hepatol 24, 517–524.[CrossRef][Medline]

Slatkin, M. (1991). Inbreeding coefficients and coalescence times. Genet Res 58, 167–175.[Medline]

Smith, D. B., Pathirana, S., Davidson, F., Lawlor, E., Power, J., Yap, P. L. & Simmonds, P. (1997). The origin of hepatitis C virus genotypes. J Gen Virol 78, 321–328.[Abstract]

Staden, R., Beal, K. F. & Bonfield, J. K. (2000). The Staden package, 1998. Methods Mol Biol 132, 115–130.[Medline]

Strimmer, K. & Pybus, O. G. (2001). Exploring the demographic history of DNA sequences using the generalized skyline plot. Mol Biol Evol 18, 2298–2305.[Abstract/Free Full Text]

Swofford, D. L. (2001). PAUP*: phylogenetic inference using parsimony (*and other methods), version 4. Sunderland, MA: Sinauer Associates.

Tanaka, Y., Hanada, K., Mizokami, M., Yeo, A. E. T., Shih, J. W.-K., Gojobori, T. & Alter, H. J. (2002). A comparison of the molecular clock of hepatitis C virus in the United States and Japan predicts that hepatocellular carcinoma incidence in the United States will increase over the next two decades. Proc Natl Acad Sci U S A 99, 15584–15589.[Abstract/Free Full Text]

Tanaka, Y., Agha, S., Saudy, N., Kurbanov, F., Orito, E., Kato, T., Abo-Zeid, M., Khalaf, M., Miyakawa, Y. & Mizokami, M. (2004). Exponential spread of hepatitis C virus genotype 4a in Egypt. J Mol Evol 58, 191–195.[CrossRef][Medline]

Thompson, J. D., Gibson, T. J., Plewniak, F., Jeanmougin, F. & Higgins, D. G. (1997). The CLUSTAL_X windows interface: flexible strategies for multiple sequence alignment aided by quality analysis tools. Nucleic Acids Res 25, 4876–4882.[Abstract/Free Full Text]

Thomson, B. J. & Finch, R. G. (2005). Hepatitis C virus infection. Clin Microbiol Infect 11, 86–94.[CrossRef][Medline]

Wasley, A. & Alter, M. J. (2000). Epidemiology of hepatitis C: geographic differences and temporal trends. Semin Liver Dis 20, 1–16.[CrossRef][Medline]

Webster, G., Barnes, E., Brown, D. & Dusheiko, G. (2000). HCV genotypes – role in pathogenesis of disease and response to therapy. Best Pract Res Clin Gastroenterol 14, 229–240.[CrossRef][Medline]

Wright, S. (1951). The genetical structure of populations. Ann Eugen 15, 323–354.

Wright, S. (1965). The interpretation of population structure by F-statistics with special regard to systems of mating. Evolution Int J Org Evolution 19, 395–420.

Yu, M. L., Chuang, W. L., Chen, S. C., Dai, C. Y., Hou, C., Wang, J. H., Lu, S. N., Huang, J. F., Lin, Z. Y. & other authors (2001). Changing prevalence of hepatitis C virus genotypes: molecular epidemiology and clinical implications in the hepatitis C virus hyperendemic areas and a tertiary referral center in Taiwan. J Med Virol 65, 58–65.[CrossRef][Medline]

Zein, N. N. (2000). Clinical significance of hepatitis C virus genotypes. Clin Microbiol Rev 13, 223–235.[Abstract/Free Full Text]

Received 6 June 2006; accepted 18 September 2006.


This article has been cited by other articles:


Home page
J. Gen. Virol.Home page
M. Torres-Puente, J. M. Cuevas, N. Jimenez-Hernandez, M. A. Bracho, I. Garcia-Robles, F. Carnicer, J. del Olmo, E. Ortega, A. Moya, and F. Gonzalez-Candelas
Contribution of insertions and deletions to the variability of hepatitis C virus populations
J. Gen. Virol., August 1, 2007; 88(8): 2198 - 2203.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Supplementary tables and figure
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Google Scholar