Recurrent Signature Patterns in HIV-1 B Clade Envelope Glycoproteins Associated with either Early or Chronic Infections

English version České info

Here we have identified HIV-1 B clade Envelope (Env) amino acid signatures from early in infection that may be favored at transmission, as well as patterns of recurrent mutation in chronic infection that may reflect common pathways of immune evasion. To accomplish this, we compared thousands of sequences derived by single genome amplification from several hundred individuals that were sampled either early in infection or were chronically infected. Samples were divided at the outset into hypothesis-forming and validation sets, and we used phylogenetically corrected statistical strategies to identify signatures, systematically scanning all of Env. Signatures included single amino acids, glycosylation motifs, and multi-site patterns based on functional or structural groupings of amino acids. We identified signatures near the CCR5 co-receptor-binding region, near the CD4 binding site, and in the signal peptide and cytoplasmic domain, which may influence Env expression and processing. Two signatures patterns associated with transmission were particularly interesting. The first was the most statistically robust signature, located in position 12 in the signal peptide. The second was the loss of an N-linked glycosylation site at positions 413–415; the presence of this site has been recently found to be associated with escape from potent and broad neutralizing antibodies, consistent with enabling a common pathway for immune escape during chronic infection. Its recurrent loss in early infection suggests it may impact fitness at the time of transmission or during early viral expansion. The signature patterns we identified implicate Env expression levels in selection at viral transmission or in early expansion, and suggest that immune evasion patterns that recur in many individuals during chronic infection when antibodies are present can be selected against when the infection is being established prior to the adaptive immune response.

Vyšlo v časopise: Recurrent Signature Patterns in HIV-1 B Clade Envelope Glycoproteins Associated with either Early or Chronic Infections. PLoS Pathog 7(9): e32767. doi:10.1371/journal.ppat.1002209
Kategorie: Research Article
prolekare.web.journal.doi_sk: https://doi.org/10.1371/journal.ppat.1002209

Souhrn

Zdroje

1. HaynesBFShattockRJ 2008 Critical issues in mucosal immunity for HIV-1 vaccine development. J Allergy Clin Immunol 122 3 9

2. Rerks-NgarmSPitisuttithumPNitayaphanSKaewkungwalJChiuJ 2009 Vaccination with ALVAC and AIDSVAX to prevent HIV-1 infection in Thailand. N Engl J Med 361 2209 2220

3. KorberBGnanakaranS 2009 The implications of patterns in HIV diversity for neutralizing antibody induction and susceptibility. Curr Opin HIV AIDS 4 408 417

4. BarouchDHKorberB 2010 HIV-1 vaccine development after STEP. Annu Rev Med 61 153 167

5. GaschenBTaylorJYusimKFoleyBGaoF 2002 Diversity considerations in HIV-1 vaccine selection. Science 296 2354 2360

6. DerdeynCADeckerJMBibollet-RucheFMokiliJLMuldoonM 2004 Envelope-constrained neutralization-sensitive HIV-1 after heterosexual transmission. Science 303 2019 2022

7. LearnGHMuthuiDBrodieSJZhuTDiemK 2002 Virus population homogenization following acute human immunodeficiency virus type 1 infection. J Virol 76 11953 11959

8. DelwartELSheppardHWWalkerBDGoudsmitJMullinsJI 1994 Human immunodeficiency virus type 1 evolution in vivo tracked by DNA heteroduplex mobility assays. J Virol 68 6672 6683

9. FurutaYBergstromTNorkransGHoralP 1994 HIV type 1 V3 sequence diversity in contact-traced Swedish couples at the time of sexual transmission. AIDS Res Hum Retroviruses 10 1187 1189

10. ShankarappaRMargolickJBGangeSJRodrigoAGUpchurchD 1999 Consistent viral evolutionary changes associated with the progression of human immunodeficiency virus type 1 infection. J Virol 73 10489 10502

11. WolinskySMWikeCMKorberBTHuttoCParksWP 1992 Selective transmission of human immunodeficiency virus type-1 variants from mothers to infants. Science 255 1134 1137

12. ZhangLQMacKenziePClelandAHolmesECBrownAJ 1993 Selection for specific sequences in the external envelope protein of human immunodeficiency virus type 1 upon primary infection. J Virol 67 3345 3356

13. ZhuTMoHWangNNamDSCaoY 1993 Genotypic and phenotypic characterization of HIV-1 patients with primary infection. Science 261 1179 1181

14. RitolaKPilcherCDFiscusSAHoffmanNGNelsonJA 2004 Multiple V1/V2 env variants are frequently present during primary infection with human immunodeficiency virus type 1. J Virol 78 11208 11218

15. WolfsTFZwartGBakkerMGoudsmitJ 1992 HIV-1 genomic RNA diversification following sexual and parenteral virus transmission. Virology 189 103 110

16. AbrahamsMRAndersonJAGiorgiEESeoigheCMlisanaK 2009 Quantitating the multiplicity of infection with human immunodeficiency virus type 1 subtype C reveals a non-poisson distribution of transmitted variants. J Virol 83 3556 3567

17. KeeleBFGiorgiEESalazar-GonzalezJFDeckerJMPhamKT 2008 Identification and characterization of transmitted and early founder virus envelopes in primary HIV-1 infection. Proc Natl Acad Sci U S A 105 7552 7557

18. LeeHYGiorgiEEKeeleBFGaschenBAthreyaGS 2009 Modeling sequence evolution in acute HIV-1 infection. J Theor Biol 261 341 360

19. KearneyMMaldarelliFShaoWMargolickJBDaarES 2009 Human immunodeficiency virus type 1 population genetics and adaptation in newly infected individuals. J Virol 83 2715 2727

20. HaalandREHawkinsPASalazar-GonzalezJJohnsonATichacekA 2009 Inflammatory genital infections mitigate a severe genetic bottleneck in heterosexual transmission of subtype A and C HIV-1. PLoS Pathog 5 e1000274

21. FiebigEWWrightDJRawalBDGarrettPESchumacherRT 2003 Dynamics of HIV viremia and antibody seroconversion in plasma donors: implications for diagnosis and staging of primary HIV infection. AIDS 17 1871 1879

22. McMichaelAJBorrowPTomarasGDGoonetillekeNHaynesBF 2009 The immune response during acute HIV-1 infection: clues for vaccine development. Nat Rev Immunol 10 11 23

23. Salazar-GonzalezJFSalazarMGKeeleBFLearnGHGiorgiEE 2009 Genetic identity, biological phenotype, and evolutionary pathways of transmitted/founder viruses in acute and early HIV-1 infection. J Exp Med 206 1273 1289

24. KeeleBFLiHLearnGHHraberPGiorgiEE 2009 Low-dose rectal inoculation of rhesus macaques by SIVsmE660 or SIVmac251 recapitulates human mucosal infection by HIV-1. J Exp Med 206 1117 1134

25. LiuJKeeleBFLiHKeatingSNorrisPJ 2010 Low-dose mucosal simian immunodeficiency virus infection restricts early replication kinetics and transmitted virus variants in rhesus monkeys. J Virol 84 10406 10412

26. LiHBarKJWangSDeckerJMChenY 2010 High Multiplicity Infection by HIV-1 in Men Who Have Sex with Men. PLoS Pathog 6 e1000890

27. BorrowPLewickiHHahnBHShawGMOldstoneMB 1994 Virus-specific CD8+ cytotoxic T-lymphocyte activity associated with control of viremia in primary human immunodeficiency virus type 1 infection. J Virol 68 6103 6110

28. BorrowPLewickiHWeiXHorwitzMSPefferN 1997 Antiviral pressure exerted by HIV-1-specific cytotoxic T lymphocytes (CTLs) during primary infection demonstrated by rapid selection of CTL escape virus. Nat Med 3 205 211

29. FischerWGanusovVVGiorgiEEHraberPTKeeleBF 2010 Transmission of single HIV-1 genomes and dynamics of early immune escape revealed by ultra-deep sequencing. PLoS ONE 5 e12303

30. GoonetillekeNLiuMKSalazar-GonzalezJFFerrariGGiorgiE 2009 The first T cell response to transmitted/founder virus contributes to the control of acute viremia in HIV-1 infection. J Exp Med 206 1253 1272

31. TurnbullELWongMWangSWeiXJonesNA 2009 Kinetics of expansion of epitope-specific T cell responses during primary HIV-1 infection. J Immunol 182 7131 7145

32. RongRLiBLynchRMHaalandREMurphyMK 2009 Escape from autologous neutralizing antibodies in acute/early subtype C HIV-1 infection requires multiple pathways. PLoS Pathog 5 e1000594

33. MoorePLRanchobeNLambsonBEGrayESCaveE 2009 Limited neutralizing antibody specificities drive neutralization escape in early HIV-1 subtype C infection. PLoS Pathog 5 e1000598

34. ChohanBLangDSagarMKorberBLavreysL 2005 Selection for human immunodeficiency virus type 1 envelope glycosylation variants with shorter V1-V2 loop sequences occurs during transmission of certain genetic subtypes and may impact viral RNA levels. J Virol 79 6528 6531

35. FrostSDLiuYPondSLChappeyCWrinT 2005 Characterization of human immunodeficiency virus type 1 (HIV-1) envelope variation and neutralizing antibody responses during transmission of HIV-1 subtype B. J Virol 79 6523 6527

36. SagarMLaeyendeckerOLeeSGamielJWawerMJ 2009 Selection of HIV variants with signature genotypic characteristics during heterosexual transmission. J Infect Dis 199 580 589

37. MargolisLShattockR 2006 Selective transmission of CCR5-utilizing HIV-1: the ‘gatekeeper’ problem resolved? Nat Rev Microbiol 4 312 317

38. Salazar-GonzalezJFBailesEPhamKTSalazarMGGuffeyMB 2008 Deciphering human immunodeficiency virus type 1 transmission and early envelope diversification by single-genome amplification and sequencing. J Virol 82 3952 3970

39. BhattacharyaTDanielsMHeckermanDFoleyBFrahmN 2007 Founder effects in the assessment of HIV polymorphisms and HLA allele associations. Science 315 1583 1586

40. GnanakaranSDanielsMGBhattacharyaTLapedesASSethiA 2010 Genetic signatures in the envelope glycoproteins of HIV-1 that associate with broadly neutralizing antibodies. PLoS Comput Biol 6 e1000955

41. StoreyJDTibshiraniR 2003 Statistical significance for genomewide studies. Proc Natl Acad Sci U S A 100 9440 9445

42. ChenLKwonYDZhouTWuXO'DellS 2009 Structural basis of immune evasion at the site of CD4 attachment on HIV-1 gp120. Science 326 1123 1127

43. RizzutoCSodroskiJ 2000 Fine definition of a conserved CCR5-binding region on the human immunodeficiency virus type 1 glycoprotein 120. AIDS Res Hum Retroviruses 16 741 749

44. RizzutoCDWyattRHernandez-RamosNSunYKwongPD 1998 A conserved HIV gp120 glycoprotein structure involved in chemokine receptor binding. Science 280 1949 1953

45. SandersRWVenturiMSchiffnerLKalyanaramanRKatingerH 2002 The mannose-dependent epitope for neutralizing antibody 2G12 on human immunodeficiency virus type 1 glycoprotein gp120. J Virol 76 7293 7305

46. ScanlanCNPantophletRWormaldMROllmann SaphireEStanfieldR 2002 The broadly neutralizing anti-human immunodeficiency virus type 1 antibody 2G12 recognizes a cluster of alpha1-->2 mannose residues on the outer face of gp120. J Virol 76 7306 7321

47. EddySR 1995 Multiple alignment using hidden Markov models. Proc Int Conf Intell Syst Mol Biol 3 114 120

48. GolubchikTWiseMJEastealSJermiinLS 2007 Mind the gaps: evidence of bias in estimates of multiple sequence alignments. Mol Biol Evol 24 2433 2442

49. KatohKAsimenosGTohH 2009 Multiple alignment of DNA sequences with MAFFT. Methods Mol Biol 537 39 64

50. KorberBMuldoonMTheilerJGaoFGuptaR 2000 Timing the ancestor of the HIV-1 pandemic strains. Science 288 1789 1796

51. KongLSheppardNCStewart-JonesGBRobsonCLChenH 2010 Expression-system-dependent modulation of HIV-1 envelope glycoprotein antigenicity and immunogenicity. J Mol Biol 403 131 147

52. SandersRWvan AnkenENabatovAALiscaljetIMBontjerI 2008 The carbohydrate at asparagine 386 on HIV-1 gp120 is not essential for protein folding and function but is involved in immune evasion. Retrovirology 5 10

53. ReitterJNMeansREDesrosiersRC 1998 A role for carbohydrates in immune evasion in AIDS. Nat Med 4 679 684

54. TrkolaAPurtscherMMusterTBallaunCBuchacherA 1996 Human monoclonal antibody 2G12 defines a distinctive neutralization epitope on the gp120 glycoprotein of human immunodeficiency virus type 1. J Virol 70 1100 1108

55. KwongPDWyattRMajeedSRobinsonJSweetRW 2000 Structures of HIV-1 gp120 envelope glycoproteins from laboratory-adapted and primary isolates. Structure 8 1329 1339

56. FelsensteinJ 1985 Phylogenies and the comparative method. Am Nat 125 1 12

57. ZhouTGeorgievIWuXYangZYDaiK 2010 Structural Basis for Broad and Potent Neutralization of HIV-1 by Antibody VRC01. Science. 329 811 817

58. ZhouTXuLDeyBHessellAJVan RykD 2007 Structural definition of a conserved neutralization epitope on HIV-1 gp120. Nature 445 732 737

59. LiuYCurlinMEDiemKZhaoHGhoshAK 2008 Env length and N-linked glycosylation following transmission of human immunodeficiency virus Type 1 subtype B viruses. Virology 374 229 233

60. GilbertPBWuCJobesDV 2008 Genome scanning tests for comparing amino acid sequences between groups. Biometrics 64 198 207

61. LandABraakmanI 2001 Folding of the human immunodeficiency virus type 1 envelope glycoprotein in the endoplasmic reticulum. Biochimie 83 783 790

62. LandAZonneveldDBraakmanI 2003 Folding of HIV-1 envelope glycoprotein involves extensive isomerization of disulfide bonds and conformation-dependent leader peptide cleavage. FASEB J 17 1058 1067

63. LiYLuoLThomasDYKangCY 1994 Control of expression, glycosylation, and secretion of HIV-1 gp120 by homologous and heterologous signal sequences. Virology 204 266 278

64. PancinoGEllerbrokHSitbonMSonigoP 1994 Conserved framework of envelope glycoproteins among lentiviruses. Curr Top Microbiol Immunol 188 77 105

65. von HeijneG 1984 Analysis of the distribution of charged residues in the N-terminal region of signal sequences: implications for protein export in prokaryotic and eukaryotic cells. EMBO J 3 2315 2318

66. BoydDBeckwithJ 1990 The role of charged amino acids in the localization of secreted and membrane proteins. Cell 62 1031 1033

67. EllerbrokHD'AuriolLVaqueroCSitbonM 1992 Functional tolerance of the human immunodeficiency virus type 1 envelope signal peptide to mutations in the amino-terminal and hydrophobic regions. J Virol 66 5114 5118

68. RehmASternPPloeghHLTortorellaD 2001 Signal peptide cleavage of a type I membrane protein, HCMV US11, is dependent on its membrane anchor. EMBO J 20 1573 1582

69. LiYBergeronJJLuoLOuWJThomasDY 1996 Effects of inefficient cleavage of the signal sequence of HIV-1 gp 120 on its association with calnexin, folding, and intracellular transport. Proc Natl Acad Sci U S A 93 9606 9611

70. HunterESwanstromR 1990 Retrovirus envelope glycoproteins. Curr Top Microbiol Immunol 157 187 253

71. YangPAiLSHuangSCLiHFChanWE 2009 The cytoplasmic domain of human immunodeficiency virus type 1 transmembrane protein gp41 harbors lipid raft association determinants. J Virol 84 59 75

72. EdwardsTGWyssSReevesJDZolla-PaznerSHoxieJA 2002 Truncation of the cytoplasmic domain induces exposure of conserved regions in the ectodomain of human immunodeficiency virus type 1 envelope protein. J Virol 76 2683 2691

73. BultmannAMuranyiWSeedBHaasJ 2001 Identification of two sequences in the cytoplasmic tail of the human immunodeficiency virus type 1 envelope glycoprotein that inhibit cell surface expression. J Virol 75 5263 5276

74. MurakamiTFreedEO 2000 The long cytoplasmic tail of gp41 is required in a cell type-dependent manner for HIV-1 envelope glycoprotein incorporation into virions. Proc Natl Acad Sci U S A 97 343 348

75. PillerSCDubayJWDerdeynCAHunterE 2000 Mutational analysis of conserved domains within the cytoplasmic tail of gp41 from human immunodeficiency virus type 1: effects on glycoprotein incorporation and infectivity. J Virol 74 11717 11723

76. JiangJAikenC 2007 Maturation-dependent human immunodeficiency virus type 1 particle fusion requires a carboxyl-terminal region of the gp41 cytoplasmic tail. J Virol 81 9999 10008

77. KaliaVSarkarSGuptaPMontelaroRC 2003 Rational site-directed mutations of the LLP-1 and LLP-2 lentivirus lytic peptide domains in the intracytoplasmic tail of human immunodeficiency virus type 1 gp41 indicate common functions in cell-cell fusion but distinct roles in virion envelope incorporation. J Virol 77 3634 3646

78. KligerYShaiY 1997 A leucine zipper-like sequence from the cytoplasmic tail of the HIV-1 envelope glycoprotein binds and perturbs lipid bilayers. Biochemistry 36 5157 5169

79. BlotGJanvierKLe PanseSBenarousRBerlioz-TorrentC 2003 Targeting of the human immunodeficiency virus type 1 envelope to the trans-Golgi network through binding to TIP47 is required for env incorporation into virions and infectivity. J Virol 77 6931 6945

80. IrunguJGoEPZhangYDalpathadoDSLiaoHX 2008 Comparison of HPLC/ESI-FTICR MS versus MALDI-TOF/TOF MS for glycopeptide analysis of a highly glycosylated HIV envelope glycoprotein. J Am Soc Mass Spectrom 19 1209 1220

81. CormierEGTranDNYukhayevaLOlsonWCDragicT 2001 Mapping the determinants of the CCR5 amino-terminal sulfopeptide interaction with soluble human immunodeficiency virus type 1 gp120-CD4 complexes. J Virol 75 5541 5549

82. SatoSYusteELauerWAChangEHMorganJS 2008 Potent antibody-mediated neutralization and evolution of antigenic escape variants of simian immunodeficiency virus strain SIVmac239 in vivo. J Virol 82 9739 9752

83. RongRGnanakaranSDeckerJMBibollet-RucheFTaylorJ 2007 Unique mutational patterns in the envelope alpha 2 amphipathic helix and acquisition of length in gp120 hypervariable domains are associated with resistance to autologous neutralization of subtype C human immunodeficiency virus type 1. J Virol 81 5658 5668

84. GnanakaranSLangDDanielsMBhattacharyaTDerdeynCA 2007 Clade-specific differences between human immunodeficiency virus type 1 clades B and C: diversity and correlations in C3-V4 regions of gp120. J Virol 81 4886 4891

85. MoorePLGrayESChogeIARanchobeNMlisanaK 2008 The c3-v4 region is a major target of autologous neutralizing antibodies in human immunodeficiency virus type 1 subtype C infection. J Virol 82 1860 1869

86. KirchherrJLHamiltonJLuXGnanakaranSMuldoonM 2011 Identification of amino acid substitutions associated with neutralization phenotype in the human immunodeficiency virus type-1 subtype C gp120. Virology 409 163 174

87. WeiXDeckerJMWangSHuiHKappesJC 2003 Antibody neutralization and escape by HIV-1. Nature 422 307 312

88. LyAStamatatosL 2000 V2 loop glycosylation of the human immunodeficiency virus type 1 SF162 envelope facilitates interaction of this protein with CD4 and CCR5 receptors and protects the virus from neutralization by anti-V3 loop and anti-CD4 binding site antibodies. J Virol 74 6769 6776

89. AuwerxJFrancoisKOCovensKVan LaethemKBalzariniJ 2008 Glycan deletions in the HIV-1 gp120 V1/V2 domain compromise viral infectivity, sensitize the mutant virus strains to carbohydrate-binding agents and represent a specific target for therapeutic intervention. Virology 382 10 19

90. DooresKJBonomelliCHarveyDJVasiljevicSDwekRA 2010 Envelope glycans of immunodeficiency virions are almost entirely oligomannose antigens. Proc Natl Acad Sci U S A 107 13800 13805

91. SterjovskiJChurchillMJEllettAGrayLRRocheMJ 2007 Asn 362 in gp120 contributes to enhanced fusogenicity by CCR5-restricted HIV-1 envelope glycoprotein variants from patients with AIDS. Retrovirology 4 89

92. LiYMiguelesSAWelcherBSvehlaKPhogatA 2007 Broad HIV-1 neutralization mediated by CD4-binding site antibodies. Nat Med 13 1032 1034

93. LiYSvehlaKLouderMKWycuffDPhogatS 2009 Analysis of neutralization specificities in polyclonal sera derived from human immunodeficiency virus type 1-infected individuals. J Virol 83 1045 1059

94. McCaffreyRASaundersCHenselMStamatatosL 2004 N-linked glycosylation of the V3 loop and the immunologically silent face of gp120 protects human immunodeficiency virus type 1 SF162 from neutralization by anti-gp120 and anti-gp41 antibodies. J Virol 78 3279 3295

95. WyattRKwongPDDesjardinsESweetRWRobinsonJ 1998 The antigenic structure of the HIV gp120 envelope glycoprotein. Nature 393 705 711

96. GeijtenbeekTBKwonDSTorensmaRvan VlietSJvan DuijnhovenGC 2000 DC-SIGN, a dendritic cell-specific HIV-1-binding protein that enhances trans-infection of T cells. Cell 100 587 597

97. HirbodTKaldensjoTLopalcoLKlareskogEAnderssonS 2009 Abundant and superficial expression of C-type lectin receptors in ectocervix of women at risk of HIV infection. J Acquir Immune Defic Syndr 51 239 247

98. WuLKewalRamaniVN 2006 Dendritic-cell interactions with HIV: infection and viral dissemination. Nat Rev Immunol 6 859 868

99. BinleyJMLybargerEACrooksETSeamanMSGrayE 2008 Profiling the specificity of neutralizing antibodies in a large panel of plasmas from patients chronically infected with human immunodeficiency virus type 1 subtypes B and C. J Virol 82 11651 11668

100. BraibantMBrunetSCostagliolaDRouziouxCAgutH 2006 Antibodies to conserved epitopes of the HIV-1 envelope in sera from long-term non-progressors: prevalence and association with neutralizing activity. AIDS 20 1923 1930

101. AstronomoRDKaltgradEUditAKWangSKDooresKJ 2010 Defining criteria for oligomannose immunogens for HIV using icosahedral virus capsid scaffolds. Chem Biol 17 357 370

102. WangSKLiangPHAstronomoRDHsuTLHsiehSL 2008 Targeting the carbohydrates on HIV-1: Interaction of oligomannose dendrons with human monoclonal antibody 2G12 and DC-SIGN. Proc Natl Acad Sci U S A 105 3690 3695

103. GrayESMoorePLChogeIADeckerJMBibollet-RucheF 2007 Neutralizing antibody responses in acute human immunodeficiency virus type 1 subtype C infection. J Virol 81 6187 6196

104. DhillonAKDonnersHPantophletRJohnsonWEDeckerJM 2007 Dissecting the neutralizing antibody specificities of broadly neutralizing sera from human immunodeficiency virus type 1-infected donors. J Virol 81 6548 6562

105. WuXYangZYLiYHogerkorpCM Schief WR, et al. 2010 Rational Design of Envelope Identifies Broadly Neutralizing Human Monoclonal Antibodies to HIV-1. Science 329 856 861

106. BrummeZLGoodrichJMayerHBBrummeCJHenrickBM 2005 Molecular and clinical epidemiology of CXCR4-using HIV-1 in a large population of antiretroviral-naive individuals. J Infect Dis 192 466 474

107. CoetzerMNedellecRSalkowitzJMcLaughlinSLiuY 2008 Evolution of CCR5 use before and during coreceptor switching. J Virol 82 11758 11766

108. WoodNBhattacharyaTKeeleBFGiorgiELiuM 2009 HIV evolution in early infection: selection pressures, patterns of insertion and deletion, and the impact of APOBEC. PLoS Pathog 5 e1000414

109. BrummeZLBrummeCJHeckermanDKorberBTDanielsM 2007 Evidence of differential HLA class I-mediated viral evolution in functional and accessory/regulatory genes of HIV-1. PLoS Pathog 3 e94

110. TreurnichtFKSeoigheCMartinDPWoodNAbrahamsMR 2009 Adaptive changes in HIV-1 subtype C proteins during early infection are driven by changes in HLA-associated immune pressure. Virology 396 213 225

111. EfronB 1983 Estimating the error rate of a prediction rule: improvement on cross-validation. J Am Stat Assoc 78 316 331

112. BengioYGrandvaletY 2004 No unbiased estimator of the variance of K-fold cross-validation. J Mach Learn Res 5 1089 1105

113. EfronBTibshiraniR 1997 Improvements on cross-validation: The .632+Bootstrap Method. J Am Stat Assoc 92 548 560

114. StoneM 1977 Asymptotics for and against cross-validation. Biometrika 64 29 35

115. BouckaertRR 2003 Choosing between two learning algorithms based on calibrated tests. 51-58 In: Proceedings of the 20th International Conference on Machine Learning; August 21-24, 2003; Washington DC, United States. Available: http://www.hpl.hp.com/conferences/icml2003/

116. SalzbergS 1997 On comparing classifiers: pitfalls to avoid and a recommended approach. Data Min Knowl Disc 1 317 328

117. XhuHRohwerR 1196 No Free Lunch for Cross-Validation. Neural Computation 8 1421 1426

118. RefaeilzadehPTangLLiuH 2009 Cross Validation. In: Liu L, Tamer Ozsu M, editors. Encyclopaedia of Database Systems. Springer, 532-538

119. KohaviR 1995 A study of cross-validation and bootstrap for accuracy estimation and model selection. The Proceedings of International Joint Conference on AL 1137 1145

120. MellquistJLKasturiLSpitalnikSLShakin-EshlemanSH 1998 The amino acid following an asn-X-Ser/Thr sequon is an important determinant of N-linked core glycosylation efficiency. Biochemistry 37 6833 6837

121. HoppTPWoodsKR 1983 A computer program for predicting protein antigenic determinants. Mol Immunol 20 483 489

122. LiMGaoFMascolaJRStamatatosLPolonisVR 2005 Human immunodeficiency virus type 1 env clones from acute and early subtype B infections for standardized assessments of vaccine-elicited neutralizing antibodies. J Virol 79 10108 10125