2013-11-17

How to download multiple files using cURL

A few months ago I've bought Kobo Aura HD eBook reader. That is my best investment this year :) I am using every chance to read books, but also I am reading magazines that do have ePub format (PragProg, Libre!, FullCircle, BSDMag and Linux Magazine.

But I've had a problem to download all issues of some magazine. If download URL for particular issue can be guessed than cURL will do the job perfectly. As example here is a command to download all 78 issues of FullCircle:

curl http://dl.fullcirclemagazine.org/issue[1-78]_en.epub --create-dirs -o "/home/zlatan/Downloads/fullcircle/fullcirclemagazine#1.epub"

Particular url is http://dl.fullcirclemagazine.org/issueXX_en.epub where XX is issue number. The option o controls output, and because there are 78 files filename will be constructed from fullcircleXX.epub name where XX is corresponding issue number taken from URL

cUrl is free software that exists as package for almost all platforms. So Linux user can use their package manager to install cUrl (if packege is not installed already) and MS Windows users can downloaded it from: http://curl.haxx.se/download.html

Simillary  to download all epub versions of PCLinuxOS Magazine copy and paste the following line into terminal:

curl http://pclosmag.com/download-epub.php?f=[2012-2013][01-12]epub.epub --create-dirs -o "/home/zkadragic/Downloads/pclinuxos/pclinuxos#1-#2.epub"