The following might be considered:
http://www.httrack.com - Allthough its built to download websites, but you can just generate a report with all link.
http://scrapy.org/download/ - Its most suitable (I think) for your needs.
I have personally used HtTrack on Windows. Its available for Linux as well. If you need additional details, add a comment.