Effects of undetected data quality issues on climatological analyses

Descripción del Articulo

Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the res...

Descripción completa

Detalles Bibliográficos
Autores: Hunziker, Stefan, Brönnimann, Stefan, Calle, J., Moreno, Isabel, Andrade, Marcos, Ticona, Laura, Huerta, Adrian, Lavado-Casimiro, W.
Formato: artículo
Fecha de Publicación:2018
Institución:Servicio Nacional de Meteorología e Hidrología del Perú
Repositorio:SENAMHI-Institucional
Lenguaje:inglés
OAI Identifier:oai:repositorio.senamhi.gob.pe:20.500.12542/92
Enlace del recurso:https://hdl.handle.net/20.500.12542/92
https://doi.org/10.5194/cp-14-1-2018
Nivel de acceso:acceso abierto
Materia:Climatology
Data quality
Data set
Numerical method
Quality control
Temperature gradient
Trend analysis
Uncertainty analysis
Weather station
https://purl.org/pe-repo/ocde/ford#1.05.09
https://purl.org/pe-repo/ocde/ford#1.05.10
temperatura - Clima y Eventos Naturales
id SEAM_f9c00fd462a21fd03eca1c7b416db91b
oai_identifier_str oai:repositorio.senamhi.gob.pe:20.500.12542/92
network_acronym_str SEAM
network_name_str SENAMHI-Institucional
repository_id_str 4818
dc.title.en_US.fl_str_mv Effects of undetected data quality issues on climatological analyses
title Effects of undetected data quality issues on climatological analyses
spellingShingle Effects of undetected data quality issues on climatological analyses
Hunziker, Stefan
Climatology
Data quality
Data set
Numerical method
Quality control
Temperature gradient
Trend analysis
Uncertainty analysis
Weather station
https://purl.org/pe-repo/ocde/ford#1.05.09
https://purl.org/pe-repo/ocde/ford#1.05.10
temperatura - Clima y Eventos Naturales
title_short Effects of undetected data quality issues on climatological analyses
title_full Effects of undetected data quality issues on climatological analyses
title_fullStr Effects of undetected data quality issues on climatological analyses
title_full_unstemmed Effects of undetected data quality issues on climatological analyses
title_sort Effects of undetected data quality issues on climatological analyses
author Hunziker, Stefan
author_facet Hunziker, Stefan
Brönnimann, Stefan
Calle, J.
Moreno, Isabel
Andrade, Marcos
Ticona, Laura
Huerta, Adrian
Lavado-Casimiro, W.
author_role author
author2 Brönnimann, Stefan
Calle, J.
Moreno, Isabel
Andrade, Marcos
Ticona, Laura
Huerta, Adrian
Lavado-Casimiro, W.
author2_role author
author
author
author
author
author
author
dc.contributor.author.fl_str_mv Hunziker, Stefan
Brönnimann, Stefan
Calle, J.
Moreno, Isabel
Andrade, Marcos
Ticona, Laura
Huerta, Adrian
Lavado-Casimiro, W.
dc.subject.en_US.fl_str_mv Climatology
Data quality
Data set
Numerical method
Quality control
Temperature gradient
Trend analysis
Uncertainty analysis
Weather station
topic Climatology
Data quality
Data set
Numerical method
Quality control
Temperature gradient
Trend analysis
Uncertainty analysis
Weather station
https://purl.org/pe-repo/ocde/ford#1.05.09
https://purl.org/pe-repo/ocde/ford#1.05.10
temperatura - Clima y Eventos Naturales
dc.subject.ocde.es_PE.fl_str_mv https://purl.org/pe-repo/ocde/ford#1.05.09
https://purl.org/pe-repo/ocde/ford#1.05.10
dc.subject.sinia.es_PE.fl_str_mv temperatura - Clima y Eventos Naturales
description Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the results of climatological analyses. For this purpose, we quality controlled daily observations of manned weather stations from the Central Andean area with a standard and an enhanced approach. The climate variables analysed are minimum and maximum temperature and precipitation. About 40ĝ% of the observations are inappropriate for the calculation of monthly temperature means and precipitation sums due to data quality issues. These quality problems undetected with the standard quality control approach strongly affect climatological analyses, since they reduce the correlation coefficients of station pairs, deteriorate the performance of data homogenization methods, increase the spread of individual station trends, and significantly bias regional temperature trends. Our findings indicate that undetected data quality issues are included in important and frequently used observational datasets and hence may affect a high number of climatological studies. It is of utmost importance to apply comprehensive and adequate data quality control approaches on manned weather station records in order to avoid biased results and large uncertainties.
publishDate 2018
dc.date.accessioned.none.fl_str_mv 2019-07-27T20:52:11Z
dc.date.available.none.fl_str_mv 2019-07-27T20:52:11Z
dc.date.issued.fl_str_mv 2018-01
dc.type.es_PE.fl_str_mv info:eu-repo/semantics/article
dc.type.sinia.es_PE.fl_str_mv text/publicacion cientifica
dc.type.version.none.fl_str_mv info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.uri.none.fl_str_mv https://hdl.handle.net/20.500.12542/92
dc.identifier.isni.none.fl_str_mv 0000 0001 0746 0446
dc.identifier.doi.none.fl_str_mv https://doi.org/10.5194/cp-14-1-2018
dc.identifier.url.none.fl_str_mv https://hdl.handle.net/20.500.12542/92
url https://hdl.handle.net/20.500.12542/92
https://doi.org/10.5194/cp-14-1-2018
identifier_str_mv 0000 0001 0746 0446
dc.language.iso.es_PE.fl_str_mv eng
language eng
dc.relation.ispartof.none.fl_str_mv urn:issn:1814-9324
dc.rights.es_PE.fl_str_mv info:eu-repo/semantics/openAccess
Reconocimiento - No comercial - Compartir igual (CC BY-NC-SA)
dc.rights.uri.es_PE.fl_str_mv https://creativecommons.org/licenses/by-nc-sa/4.0/
eu_rights_str_mv openAccess
rights_invalid_str_mv Reconocimiento - No comercial - Compartir igual (CC BY-NC-SA)
https://creativecommons.org/licenses/by-nc-sa/4.0/
dc.format.es_PE.fl_str_mv application/pdf
dc.publisher.es_PE.fl_str_mv Copernicus GmbH
dc.source.es_PE.fl_str_mv Servicio Nacional de Meteorología e Hidrología del Perú
Repositorio Institucional - SENAMHI
dc.source.none.fl_str_mv reponame:SENAMHI-Institucional
instname:Servicio Nacional de Meteorología e Hidrología del Perú
instacron:SENAMHI
instname_str Servicio Nacional de Meteorología e Hidrología del Perú
instacron_str SENAMHI
institution SENAMHI
reponame_str SENAMHI-Institucional
collection SENAMHI-Institucional
dc.source.volume.es_PE.fl_str_mv 14
dc.source.issue.es_PE.fl_str_mv 1
dc.source.initialpage.es_PE.fl_str_mv 1
dc.source.endpage.es_PE.fl_str_mv 20
dc.source.journal.es_PE.fl_str_mv Climate of the Past
bitstream.url.fl_str_mv http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/1/Hunziker-2018-Effects-of-undetected-data-quality-.pdf
http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/2/license_rdf
http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/3/license.txt
http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/4/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.txt
http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/5/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.jpg
bitstream.checksum.fl_str_mv dfd9ea73dc372ea849910401c8457020
80294ba9ff4c5b4f07812ee200fbc42f
8a4605be74aa9ea9d79846c1fba20a33
a41c2ccb9591fe7e46f3ad35ac5458f1
b20e7992a4d2e7065efb7e88f19e4a05
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositorio Institucional SENAMHI
repository.mail.fl_str_mv repositorio@senamhi.gob.pe
_version_ 1846967681385758720
spelling Hunziker, StefanBrönnimann, StefanCalle, J.Moreno, IsabelAndrade, MarcosTicona, LauraHuerta, AdrianLavado-Casimiro, W.2019-07-27T20:52:11Z2019-07-27T20:52:11Z2018-01https://hdl.handle.net/20.500.12542/920000 0001 0746 0446https://doi.org/10.5194/cp-14-1-2018https://hdl.handle.net/20.500.12542/92Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the results of climatological analyses. For this purpose, we quality controlled daily observations of manned weather stations from the Central Andean area with a standard and an enhanced approach. The climate variables analysed are minimum and maximum temperature and precipitation. About 40ĝ% of the observations are inappropriate for the calculation of monthly temperature means and precipitation sums due to data quality issues. These quality problems undetected with the standard quality control approach strongly affect climatological analyses, since they reduce the correlation coefficients of station pairs, deteriorate the performance of data homogenization methods, increase the spread of individual station trends, and significantly bias regional temperature trends. Our findings indicate that undetected data quality issues are included in important and frequently used observational datasets and hence may affect a high number of climatological studies. It is of utmost importance to apply comprehensive and adequate data quality control approaches on manned weather station records in order to avoid biased results and large uncertainties.Por paresapplication/pdfengCopernicus GmbHurn:issn:1814-9324info:eu-repo/semantics/openAccessReconocimiento - No comercial - Compartir igual (CC BY-NC-SA)https://creativecommons.org/licenses/by-nc-sa/4.0/Servicio Nacional de Meteorología e Hidrología del PerúRepositorio Institucional - SENAMHI141120Climate of the Pastreponame:SENAMHI-Institucionalinstname:Servicio Nacional de Meteorología e Hidrología del Perúinstacron:SENAMHIClimatologyData qualityData setNumerical methodQuality controlTemperature gradientTrend analysisUncertainty analysisWeather stationhttps://purl.org/pe-repo/ocde/ford#1.05.09https://purl.org/pe-repo/ocde/ford#1.05.10temperatura - Clima y Eventos NaturalesEffects of undetected data quality issues on climatological analysesinfo:eu-repo/semantics/articletext/publicacion cientificainfo:eu-repo/semantics/acceptedVersionORIGINALHunziker-2018-Effects-of-undetected-data-quality-.pdfHunziker-2018-Effects-of-undetected-data-quality-.pdfapplication/pdf5304979http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/1/Hunziker-2018-Effects-of-undetected-data-quality-.pdfdfd9ea73dc372ea849910401c8457020MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81037http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/2/license_rdf80294ba9ff4c5b4f07812ee200fbc42fMD52LICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/3/license.txt8a4605be74aa9ea9d79846c1fba20a33MD53TEXTHunziker-2018-Effects-of-undetected-data-quality-.pdf.txtHunziker-2018-Effects-of-undetected-data-quality-.pdf.txtExtracted texttext/plain94582http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/4/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.txta41c2ccb9591fe7e46f3ad35ac5458f1MD54THUMBNAILHunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgHunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgGenerated Thumbnailimage/jpeg7941http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/5/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgb20e7992a4d2e7065efb7e88f19e4a05MD5520.500.12542/92oai:repositorio.senamhi.gob.pe:20.500.12542/922025-10-23 17:05:04.211Repositorio Institucional SENAMHIrepositorio@senamhi.gob.peTk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=
score 13.476704
Nota importante:
La información contenida en este registro es de entera responsabilidad de la institución que gestiona el repositorio institucional donde esta contenido este documento o set de datos. El CONCYTEC no se hace responsable por los contenidos (publicaciones y/o datos) accesibles a través del Repositorio Nacional Digital de Ciencia, Tecnología e Innovación de Acceso Abierto (ALICIA).