Code development platform for open source projects from the European Union institutions 🔵 EU Login authentication by SMS has been phased out. To see alternatives please check here

Skip to content

Improve local sha1 check error handling

Currently, a failed download file in _preprocess_daily_dumps will raise and skip.

Expected behavior should be either:

  • Trying to re-download and validate the file (chunking it if necessary).
  • Raise error and exit (not to pollute downstream aggregations).
Edited by Enrico UBALDI