Large file download

Question

[MattiaF]

Hi everyone,

I need to download a large file (~40Gb) from this online repository (https://data.goettingen-research-online.de/dataverse/gro) which, unfortunately, has some sort of timeout setting that interrupts the connection after 15 minutes.

I already tried to exploit wget in order to re-start the download but it is not working.

Do you have any suggestion on how to proceed in similar situations?

Thank you!

Mattia

Answer 1

[Matthias Zepper]

wget has a --continue flag and this should work unless the URL changes upon retry.

Alternatively, you could use curl with the -C flag so it resumes automatically.