Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru

Descripción del Articulo

Widely available and reliable testing for SARS-CoV-2 is essential for the public health response to the COVID-19 pandemic. We estimated the diagnostic performance of reverse transcription PCR (RT-PCR) performed on saliva and the SD Biosensor STANDARD Q antigen test performed on nasopharyngeal swab c...

Descripción completa

Detalles Bibliográficos
Autores: Calderón, Roger I., Jhaveri, Tulip A., Tovar, Marco A., Palomino, J. Santiago, Barreda, Nadia N., Sanabria, Oswaldo M., Peinado, Jesús, Ramirez, Claudio, Zavalaga, L. Fernando Llanos, Valderrama, Gissela, Franke, Molly F., Mitnick, Carole D., Lecca, Leonid, Velásquez, Gustavo E.
Formato: artículo
Fecha de Publicación:2022
Institución:Universidad Peruana de Ciencias Aplicadas
Repositorio:UPC-Institucional
Lenguaje:inglés
OAI Identifier:oai:repositorioacademico.upc.edu.pe:10757/668935
Enlace del recurso:http://hdl.handle.net/10757/668935
Nivel de acceso:acceso abierto
Materia:antigen
COVID-19
diagnosis
nasopharyngeal swab
Peru
RT-PCR
saliva
SARS-CoV-2
validation
id UUPC_eab50af95bcd2b8a8d4b84b8848ca161
oai_identifier_str oai:repositorioacademico.upc.edu.pe:10757/668935
network_acronym_str UUPC
network_name_str UPC-Institucional
repository_id_str 2670
dc.title.es_PE.fl_str_mv Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
title Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
spellingShingle Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
Calderón, Roger I.
antigen
COVID-19
diagnosis
nasopharyngeal swab
Peru
RT-PCR
saliva
SARS-CoV-2
validation
title_short Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
title_full Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
title_fullStr Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
title_full_unstemmed Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
title_sort Diagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peru
author Calderón, Roger I.
author_facet Calderón, Roger I.
Jhaveri, Tulip A.
Tovar, Marco A.
Palomino, J. Santiago
Barreda, Nadia N.
Sanabria, Oswaldo M.
Peinado, Jesús
Ramirez, Claudio
Zavalaga, L. Fernando Llanos
Valderrama, Gissela
Franke, Molly F.
Mitnick, Carole D.
Lecca, Leonid
Velásquez, Gustavo E.
author_role author
author2 Jhaveri, Tulip A.
Tovar, Marco A.
Palomino, J. Santiago
Barreda, Nadia N.
Sanabria, Oswaldo M.
Peinado, Jesús
Ramirez, Claudio
Zavalaga, L. Fernando Llanos
Valderrama, Gissela
Franke, Molly F.
Mitnick, Carole D.
Lecca, Leonid
Velásquez, Gustavo E.
author2_role author
author
author
author
author
author
author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv Calderón, Roger I.
Jhaveri, Tulip A.
Tovar, Marco A.
Palomino, J. Santiago
Barreda, Nadia N.
Sanabria, Oswaldo M.
Peinado, Jesús
Ramirez, Claudio
Zavalaga, L. Fernando Llanos
Valderrama, Gissela
Franke, Molly F.
Mitnick, Carole D.
Lecca, Leonid
Velásquez, Gustavo E.
dc.subject.es_PE.fl_str_mv antigen
COVID-19
diagnosis
nasopharyngeal swab
Peru
RT-PCR
saliva
SARS-CoV-2
validation
topic antigen
COVID-19
diagnosis
nasopharyngeal swab
Peru
RT-PCR
saliva
SARS-CoV-2
validation
description Widely available and reliable testing for SARS-CoV-2 is essential for the public health response to the COVID-19 pandemic. We estimated the diagnostic performance of reverse transcription PCR (RT-PCR) performed on saliva and the SD Biosensor STANDARD Q antigen test performed on nasopharyngeal swab compared to the reference standard, nasopharyngeal swab (NP) RT-PCR. We enrolled participants living and/or seeking care in health facilities in North Lima, Peru from November 2020 to January 2021. Consenting participants underwent same-day RT-PCR on both saliva and nasopharyngeal swab specimens, antigen testing on a nasopharyngeal swab specimen, pulse oximetry, and standardized symptom assessment. We calculated sensitivity, specificity, and predictive values for the nasopharyngeal antigen and saliva RT-PCR compared to nasopharyngeal RT-PCR. Of 896 participants analyzed, 567 (63.3%) had acute signs/symptoms of COVID-19. The overall sensitivity and specificity of saliva RT-PCR were 85.8% and 98.1%, respectively. Among participants with and without acute signs/symptoms of COVID-19, saliva sensitivity was 87.3% and 37.5%, respectively. Saliva sensitivity was 97.4% and 56.0% among participants with cycle threshold (CT) values of #30 and .30 on nasopharyngeal RT-PCR, respectively. The overall sensitivity and specificity of nasopharyngeal antigen were 73.2% and 99.4%, respectively. The sensitivity of the nasopharyngeal antigen test was 75.1% and 12.5% among participants with and without acute signs/symptoms of COVID-19, and 91.2% and 26.7% among participants with CT values of #30 and .30 on nasopharyngeal RT-PCR, respectively. Saliva RT-PCR achieved the WHO-recommended threshold of .80% for sensitivity for the detection of SARS-CoV-2, while the SD Biosensor nasopharyngeal antigen test did not. IMPORTANCE In this diagnostic validation study of 896 participants in Peru, saliva reverse transcription PCR (RT-PCR) had .80% sensitivity for the detection of SARS-CoV-2 among all-comers and symptomatic individuals, while the SD Biosensor STANDARD Q antigen test performed on nasopharyngeal swab had,80% sensitivity, except for participants whose same-day nasopharyngeal RT-PCR results showed cycle threshold values of,30, consistent with a high viral load in the nasopharynx. The specificity was high for both tests. Our results demonstrate that saliva sampling could serve as an alternative noninvasive technique for RT-PCR diagnosis of SARS-CoV-2. The role of nasopharyngeal antigen testing is more limited; when community transmission is low, it may be used for mass screenings among asymptomatic individuals with high testing frequency. Among symptomatic individuals, the nasopharyngeal antigen test may be relied upon for 4 to 8 days after symptom onset, or in those likely to have high viral load, whereupon it showed .80% sensitivity.
publishDate 2022
dc.date.accessioned.none.fl_str_mv 2023-10-11T17:07:03Z
dc.date.available.none.fl_str_mv 2023-10-11T17:07:03Z
dc.date.issued.fl_str_mv 2022-08-01
dc.type.es_PE.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.doi.none.fl_str_mv 10.1128/spectrum.00861-22
dc.identifier.uri.none.fl_str_mv http://hdl.handle.net/10757/668935
dc.identifier.eissn.none.fl_str_mv 21650497
dc.identifier.journal.es_PE.fl_str_mv Microbiology Spectrum
dc.identifier.eid.none.fl_str_mv 2-s2.0-85137135769
dc.identifier.scopusid.none.fl_str_mv SCOPUS_ID:85137135769
dc.identifier.isni.none.fl_str_mv 0000 0001 2196 144X
dc.identifier.ror.none.fl_str_mv 047xrr705
identifier_str_mv 10.1128/spectrum.00861-22
21650497
Microbiology Spectrum
2-s2.0-85137135769
SCOPUS_ID:85137135769
0000 0001 2196 144X
047xrr705
url http://hdl.handle.net/10757/668935
dc.language.iso.es_PE.fl_str_mv eng
language eng
dc.relation.url.es_PE.fl_str_mv https://journals.asm.org/doi/10.1128/spectrum.00861-22
dc.rights.es_PE.fl_str_mv info:eu-repo/semantics/openAccess
dc.rights.*.fl_str_mv Attribution-NonCommercial-ShareAlike 4.0 International
dc.rights.uri.*.fl_str_mv http://creativecommons.org/licenses/by-nc-sa/4.0/
eu_rights_str_mv openAccess
rights_invalid_str_mv Attribution-NonCommercial-ShareAlike 4.0 International
http://creativecommons.org/licenses/by-nc-sa/4.0/
dc.format.es_PE.fl_str_mv application/pdf
dc.publisher.es_PE.fl_str_mv American Society for Microbiology
dc.source.es_PE.fl_str_mv Universidad Peruana de Ciencias Aplicadas (UPC)
Repositorio Academico - UPC
dc.source.none.fl_str_mv reponame:UPC-Institucional
instname:Universidad Peruana de Ciencias Aplicadas
instacron:UPC
instname_str Universidad Peruana de Ciencias Aplicadas
instacron_str UPC
institution UPC
reponame_str UPC-Institucional
collection UPC-Institucional
dc.source.journaltitle.none.fl_str_mv Microbiology Spectrum
dc.source.volume.none.fl_str_mv 10
dc.source.issue.none.fl_str_mv 4
bitstream.url.fl_str_mv https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/5/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.jpg
https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/4/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.txt
https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/3/license.txt
https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/2/license_rdf
https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/1/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf
bitstream.checksum.fl_str_mv c0df9c5e7b7a0ac118eb9ab7568f65e6
9298d41176607e67cc93f7d898a3310f
8a4605be74aa9ea9d79846c1fba20a33
934f4ca17e109e0a05eaeaba504d7ce4
68b4637c3e982bb811a6778bb56d4e49
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio académico upc
repository.mail.fl_str_mv upc@openrepository.com
_version_ 1837186804646674432
spelling fdc4924ae353267b0b7000af44f3a8d4500d067099e555a12a53abab5983c04d390300c7d07afc30e00159f82262625e6a80e35009011ba869928d9e167623f191cd47bdd30052e5206c43f827f52c8d2c6c60b70089300d6db9ca2f29f16345527e4825a3bdfed3006fe0cbb916267c2317606e1cc98666f9500244e57ae39993c063babea31cef262bd3007a5806cd50eab7a9fd08c7fcf24940ba300b620ff3f7772cdd11d4281e1b19486eb3005d67eb6d156a10be485cb2d5558c386e5001e4b7c44b4ead4a50c186fb755dcdcad500a491e98d9e17bf4bf62c9b46483689ec5003ac8c2a457cb5ab829892f22107cea2d500Calderón, Roger I.Jhaveri, Tulip A.Tovar, Marco A.Palomino, J. SantiagoBarreda, Nadia N.Sanabria, Oswaldo M.Peinado, JesúsRamirez, ClaudioZavalaga, L. Fernando LlanosValderrama, GisselaFranke, Molly F.Mitnick, Carole D.Lecca, LeonidVelásquez, Gustavo E.2023-10-11T17:07:03Z2023-10-11T17:07:03Z2022-08-0110.1128/spectrum.00861-22http://hdl.handle.net/10757/66893521650497Microbiology Spectrum2-s2.0-85137135769SCOPUS_ID:851371357690000 0001 2196 144X047xrr705Widely available and reliable testing for SARS-CoV-2 is essential for the public health response to the COVID-19 pandemic. We estimated the diagnostic performance of reverse transcription PCR (RT-PCR) performed on saliva and the SD Biosensor STANDARD Q antigen test performed on nasopharyngeal swab compared to the reference standard, nasopharyngeal swab (NP) RT-PCR. We enrolled participants living and/or seeking care in health facilities in North Lima, Peru from November 2020 to January 2021. Consenting participants underwent same-day RT-PCR on both saliva and nasopharyngeal swab specimens, antigen testing on a nasopharyngeal swab specimen, pulse oximetry, and standardized symptom assessment. We calculated sensitivity, specificity, and predictive values for the nasopharyngeal antigen and saliva RT-PCR compared to nasopharyngeal RT-PCR. Of 896 participants analyzed, 567 (63.3%) had acute signs/symptoms of COVID-19. The overall sensitivity and specificity of saliva RT-PCR were 85.8% and 98.1%, respectively. Among participants with and without acute signs/symptoms of COVID-19, saliva sensitivity was 87.3% and 37.5%, respectively. Saliva sensitivity was 97.4% and 56.0% among participants with cycle threshold (CT) values of #30 and .30 on nasopharyngeal RT-PCR, respectively. The overall sensitivity and specificity of nasopharyngeal antigen were 73.2% and 99.4%, respectively. The sensitivity of the nasopharyngeal antigen test was 75.1% and 12.5% among participants with and without acute signs/symptoms of COVID-19, and 91.2% and 26.7% among participants with CT values of #30 and .30 on nasopharyngeal RT-PCR, respectively. Saliva RT-PCR achieved the WHO-recommended threshold of .80% for sensitivity for the detection of SARS-CoV-2, while the SD Biosensor nasopharyngeal antigen test did not. IMPORTANCE In this diagnostic validation study of 896 participants in Peru, saliva reverse transcription PCR (RT-PCR) had .80% sensitivity for the detection of SARS-CoV-2 among all-comers and symptomatic individuals, while the SD Biosensor STANDARD Q antigen test performed on nasopharyngeal swab had,80% sensitivity, except for participants whose same-day nasopharyngeal RT-PCR results showed cycle threshold values of,30, consistent with a high viral load in the nasopharynx. The specificity was high for both tests. Our results demonstrate that saliva sampling could serve as an alternative noninvasive technique for RT-PCR diagnosis of SARS-CoV-2. The role of nasopharyngeal antigen testing is more limited; when community transmission is low, it may be used for mass screenings among asymptomatic individuals with high testing frequency. Among symptomatic individuals, the nasopharyngeal antigen test may be relied upon for 4 to 8 days after symptom onset, or in those likely to have high viral load, whereupon it showed .80% sensitivity.Revisión por paresapplication/pdfengAmerican Society for Microbiologyhttps://journals.asm.org/doi/10.1128/spectrum.00861-22info:eu-repo/semantics/openAccessAttribution-NonCommercial-ShareAlike 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-sa/4.0/Universidad Peruana de Ciencias Aplicadas (UPC)Repositorio Academico - UPCMicrobiology Spectrum104reponame:UPC-Institucionalinstname:Universidad Peruana de Ciencias Aplicadasinstacron:UPCantigenCOVID-19diagnosisnasopharyngeal swabPeruRT-PCRsalivaSARS-CoV-2validationDiagnostic Performance Assessment of Saliva RT-PCR and Nasopharyngeal Antigen for the Detection of SARS-CoV-2 in Peruinfo:eu-repo/semantics/article2023-10-11T17:07:04ZTHUMBNAILcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.jpgcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.jpgGenerated Thumbnailimage/jpeg120405https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/5/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.jpgc0df9c5e7b7a0ac118eb9ab7568f65e6MD55falseTEXTcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.txtcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.txtExtracted texttext/plain46726https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/4/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf.txt9298d41176607e67cc93f7d898a3310fMD54falseLICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/3/license.txt8a4605be74aa9ea9d79846c1fba20a33MD53falseCC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81031https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/2/license_rdf934f4ca17e109e0a05eaeaba504d7ce4MD52falseORIGINALcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdfcalderón-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdfapplication/pdf774490https://repositorioacademico.upc.edu.pe/bitstream/10757/668935/1/calder%c3%b3n-et-al-2022-diagnostic-performance-assessment-of-saliva-rt-pcr-and-nasopharyngeal-antigen-for-the-detection-of.pdf68b4637c3e982bb811a6778bb56d4e49MD51true10757/668935oai:repositorioacademico.upc.edu.pe:10757/6689352023-10-12 03:25:18.15Repositorio académico upcupc@openrepository.comTk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=
score 13.949927
Nota importante:
La información contenida en este registro es de entera responsabilidad de la institución que gestiona el repositorio institucional donde esta contenido este documento o set de datos. El CONCYTEC no se hace responsable por los contenidos (publicaciones y/o datos) accesibles a través del Repositorio Nacional Digital de Ciencia, Tecnología e Innovación de Acceso Abierto (ALICIA).