Effects of undetected data quality issues on climatological analyses
Descripción del Articulo
Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the res...
| Autores: | , , , , , , , |
|---|---|
| Formato: | artículo |
| Fecha de Publicación: | 2018 |
| Institución: | Servicio Nacional de Meteorología e Hidrología del Perú |
| Repositorio: | SENAMHI-Institucional |
| Lenguaje: | inglés |
| OAI Identifier: | oai:repositorio.senamhi.gob.pe:20.500.12542/92 |
| Enlace del recurso: | https://hdl.handle.net/20.500.12542/92 https://doi.org/10.5194/cp-14-1-2018 |
| Nivel de acceso: | acceso abierto |
| Materia: | Climatology Data quality Data set Numerical method Quality control Temperature gradient Trend analysis Uncertainty analysis Weather station https://purl.org/pe-repo/ocde/ford#1.05.09 https://purl.org/pe-repo/ocde/ford#1.05.10 temperatura - Clima y Eventos Naturales |
| id |
SEAM_f9c00fd462a21fd03eca1c7b416db91b |
|---|---|
| oai_identifier_str |
oai:repositorio.senamhi.gob.pe:20.500.12542/92 |
| network_acronym_str |
SEAM |
| network_name_str |
SENAMHI-Institucional |
| repository_id_str |
4818 |
| dc.title.en_US.fl_str_mv |
Effects of undetected data quality issues on climatological analyses |
| title |
Effects of undetected data quality issues on climatological analyses |
| spellingShingle |
Effects of undetected data quality issues on climatological analyses Hunziker, Stefan Climatology Data quality Data set Numerical method Quality control Temperature gradient Trend analysis Uncertainty analysis Weather station https://purl.org/pe-repo/ocde/ford#1.05.09 https://purl.org/pe-repo/ocde/ford#1.05.10 temperatura - Clima y Eventos Naturales |
| title_short |
Effects of undetected data quality issues on climatological analyses |
| title_full |
Effects of undetected data quality issues on climatological analyses |
| title_fullStr |
Effects of undetected data quality issues on climatological analyses |
| title_full_unstemmed |
Effects of undetected data quality issues on climatological analyses |
| title_sort |
Effects of undetected data quality issues on climatological analyses |
| author |
Hunziker, Stefan |
| author_facet |
Hunziker, Stefan Brönnimann, Stefan Calle, J. Moreno, Isabel Andrade, Marcos Ticona, Laura Huerta, Adrian Lavado-Casimiro, W. |
| author_role |
author |
| author2 |
Brönnimann, Stefan Calle, J. Moreno, Isabel Andrade, Marcos Ticona, Laura Huerta, Adrian Lavado-Casimiro, W. |
| author2_role |
author author author author author author author |
| dc.contributor.author.fl_str_mv |
Hunziker, Stefan Brönnimann, Stefan Calle, J. Moreno, Isabel Andrade, Marcos Ticona, Laura Huerta, Adrian Lavado-Casimiro, W. |
| dc.subject.en_US.fl_str_mv |
Climatology Data quality Data set Numerical method Quality control Temperature gradient Trend analysis Uncertainty analysis Weather station |
| topic |
Climatology Data quality Data set Numerical method Quality control Temperature gradient Trend analysis Uncertainty analysis Weather station https://purl.org/pe-repo/ocde/ford#1.05.09 https://purl.org/pe-repo/ocde/ford#1.05.10 temperatura - Clima y Eventos Naturales |
| dc.subject.ocde.es_PE.fl_str_mv |
https://purl.org/pe-repo/ocde/ford#1.05.09 https://purl.org/pe-repo/ocde/ford#1.05.10 |
| dc.subject.sinia.es_PE.fl_str_mv |
temperatura - Clima y Eventos Naturales |
| description |
Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the results of climatological analyses. For this purpose, we quality controlled daily observations of manned weather stations from the Central Andean area with a standard and an enhanced approach. The climate variables analysed are minimum and maximum temperature and precipitation. About 40ĝ% of the observations are inappropriate for the calculation of monthly temperature means and precipitation sums due to data quality issues. These quality problems undetected with the standard quality control approach strongly affect climatological analyses, since they reduce the correlation coefficients of station pairs, deteriorate the performance of data homogenization methods, increase the spread of individual station trends, and significantly bias regional temperature trends. Our findings indicate that undetected data quality issues are included in important and frequently used observational datasets and hence may affect a high number of climatological studies. It is of utmost importance to apply comprehensive and adequate data quality control approaches on manned weather station records in order to avoid biased results and large uncertainties. |
| publishDate |
2018 |
| dc.date.accessioned.none.fl_str_mv |
2019-07-27T20:52:11Z |
| dc.date.available.none.fl_str_mv |
2019-07-27T20:52:11Z |
| dc.date.issued.fl_str_mv |
2018-01 |
| dc.type.es_PE.fl_str_mv |
info:eu-repo/semantics/article |
| dc.type.sinia.es_PE.fl_str_mv |
text/publicacion cientifica |
| dc.type.version.none.fl_str_mv |
info:eu-repo/semantics/acceptedVersion |
| format |
article |
| status_str |
acceptedVersion |
| dc.identifier.uri.none.fl_str_mv |
https://hdl.handle.net/20.500.12542/92 |
| dc.identifier.isni.none.fl_str_mv |
0000 0001 0746 0446 |
| dc.identifier.doi.none.fl_str_mv |
https://doi.org/10.5194/cp-14-1-2018 |
| dc.identifier.url.none.fl_str_mv |
https://hdl.handle.net/20.500.12542/92 |
| url |
https://hdl.handle.net/20.500.12542/92 https://doi.org/10.5194/cp-14-1-2018 |
| identifier_str_mv |
0000 0001 0746 0446 |
| dc.language.iso.es_PE.fl_str_mv |
eng |
| language |
eng |
| dc.relation.ispartof.none.fl_str_mv |
urn:issn:1814-9324 |
| dc.rights.es_PE.fl_str_mv |
info:eu-repo/semantics/openAccess Reconocimiento - No comercial - Compartir igual (CC BY-NC-SA) |
| dc.rights.uri.es_PE.fl_str_mv |
https://creativecommons.org/licenses/by-nc-sa/4.0/ |
| eu_rights_str_mv |
openAccess |
| rights_invalid_str_mv |
Reconocimiento - No comercial - Compartir igual (CC BY-NC-SA) https://creativecommons.org/licenses/by-nc-sa/4.0/ |
| dc.format.es_PE.fl_str_mv |
application/pdf |
| dc.publisher.es_PE.fl_str_mv |
Copernicus GmbH |
| dc.source.es_PE.fl_str_mv |
Servicio Nacional de Meteorología e Hidrología del Perú Repositorio Institucional - SENAMHI |
| dc.source.none.fl_str_mv |
reponame:SENAMHI-Institucional instname:Servicio Nacional de Meteorología e Hidrología del Perú instacron:SENAMHI |
| instname_str |
Servicio Nacional de Meteorología e Hidrología del Perú |
| instacron_str |
SENAMHI |
| institution |
SENAMHI |
| reponame_str |
SENAMHI-Institucional |
| collection |
SENAMHI-Institucional |
| dc.source.volume.es_PE.fl_str_mv |
14 |
| dc.source.issue.es_PE.fl_str_mv |
1 |
| dc.source.initialpage.es_PE.fl_str_mv |
1 |
| dc.source.endpage.es_PE.fl_str_mv |
20 |
| dc.source.journal.es_PE.fl_str_mv |
Climate of the Past |
| bitstream.url.fl_str_mv |
http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/1/Hunziker-2018-Effects-of-undetected-data-quality-.pdf http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/2/license_rdf http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/3/license.txt http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/4/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.txt http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/5/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.jpg |
| bitstream.checksum.fl_str_mv |
dfd9ea73dc372ea849910401c8457020 80294ba9ff4c5b4f07812ee200fbc42f 8a4605be74aa9ea9d79846c1fba20a33 a41c2ccb9591fe7e46f3ad35ac5458f1 b20e7992a4d2e7065efb7e88f19e4a05 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 MD5 |
| repository.name.fl_str_mv |
Repositorio Institucional SENAMHI |
| repository.mail.fl_str_mv |
repositorio@senamhi.gob.pe |
| _version_ |
1846967681385758720 |
| spelling |
Hunziker, StefanBrönnimann, StefanCalle, J.Moreno, IsabelAndrade, MarcosTicona, LauraHuerta, AdrianLavado-Casimiro, W.2019-07-27T20:52:11Z2019-07-27T20:52:11Z2018-01https://hdl.handle.net/20.500.12542/920000 0001 0746 0446https://doi.org/10.5194/cp-14-1-2018https://hdl.handle.net/20.500.12542/92Systematic data quality issues may occur at various stages of the data generation process. They may affect large fractions of observational datasets and remain largely undetected with standard data quality control. This study investigates the effects of such undetected data quality issues on the results of climatological analyses. For this purpose, we quality controlled daily observations of manned weather stations from the Central Andean area with a standard and an enhanced approach. The climate variables analysed are minimum and maximum temperature and precipitation. About 40ĝ% of the observations are inappropriate for the calculation of monthly temperature means and precipitation sums due to data quality issues. These quality problems undetected with the standard quality control approach strongly affect climatological analyses, since they reduce the correlation coefficients of station pairs, deteriorate the performance of data homogenization methods, increase the spread of individual station trends, and significantly bias regional temperature trends. Our findings indicate that undetected data quality issues are included in important and frequently used observational datasets and hence may affect a high number of climatological studies. It is of utmost importance to apply comprehensive and adequate data quality control approaches on manned weather station records in order to avoid biased results and large uncertainties.Por paresapplication/pdfengCopernicus GmbHurn:issn:1814-9324info:eu-repo/semantics/openAccessReconocimiento - No comercial - Compartir igual (CC BY-NC-SA)https://creativecommons.org/licenses/by-nc-sa/4.0/Servicio Nacional de Meteorología e Hidrología del PerúRepositorio Institucional - SENAMHI141120Climate of the Pastreponame:SENAMHI-Institucionalinstname:Servicio Nacional de Meteorología e Hidrología del Perúinstacron:SENAMHIClimatologyData qualityData setNumerical methodQuality controlTemperature gradientTrend analysisUncertainty analysisWeather stationhttps://purl.org/pe-repo/ocde/ford#1.05.09https://purl.org/pe-repo/ocde/ford#1.05.10temperatura - Clima y Eventos NaturalesEffects of undetected data quality issues on climatological analysesinfo:eu-repo/semantics/articletext/publicacion cientificainfo:eu-repo/semantics/acceptedVersionORIGINALHunziker-2018-Effects-of-undetected-data-quality-.pdfHunziker-2018-Effects-of-undetected-data-quality-.pdfapplication/pdf5304979http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/1/Hunziker-2018-Effects-of-undetected-data-quality-.pdfdfd9ea73dc372ea849910401c8457020MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81037http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/2/license_rdf80294ba9ff4c5b4f07812ee200fbc42fMD52LICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/3/license.txt8a4605be74aa9ea9d79846c1fba20a33MD53TEXTHunziker-2018-Effects-of-undetected-data-quality-.pdf.txtHunziker-2018-Effects-of-undetected-data-quality-.pdf.txtExtracted texttext/plain94582http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/4/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.txta41c2ccb9591fe7e46f3ad35ac5458f1MD54THUMBNAILHunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgHunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgGenerated Thumbnailimage/jpeg7941http://repositorio.senamhi.gob.pe/bitstream/20.500.12542/92/5/Hunziker-2018-Effects-of-undetected-data-quality-.pdf.jpgb20e7992a4d2e7065efb7e88f19e4a05MD5520.500.12542/92oai:repositorio.senamhi.gob.pe:20.500.12542/922025-10-23 17:05:04.211Repositorio Institucional SENAMHIrepositorio@senamhi.gob.peTk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo= |
| score |
13.476704 |
Nota importante:
La información contenida en este registro es de entera responsabilidad de la institución que gestiona el repositorio institucional donde esta contenido este documento o set de datos. El CONCYTEC no se hace responsable por los contenidos (publicaciones y/o datos) accesibles a través del Repositorio Nacional Digital de Ciencia, Tecnología e Innovación de Acceso Abierto (ALICIA).
La información contenida en este registro es de entera responsabilidad de la institución que gestiona el repositorio institucional donde esta contenido este documento o set de datos. El CONCYTEC no se hace responsable por los contenidos (publicaciones y/o datos) accesibles a través del Repositorio Nacional Digital de Ciencia, Tecnología e Innovación de Acceso Abierto (ALICIA).