http://liketheriffle.livejournal.com/ ([identity profile] liketheriffle.livejournal.com) wrote in [community profile] fanfic_ebooks2012-10-02 12:32 pm

Mass story download

I know I'm new, so I hope it's alright for me to ask a question. Is there any way to download stories in bulk from fanfiction.net? Like an author's favorites list, or even the entire Harry Potter section. I know this is probably a bit of a long shot, but I just thought I'd ask, in case anyone has anything  that does what I'm looking for. Thanks to anyone who replies.
ext_1951: (made by a friend)

[identity profile] mremre.livejournal.com 2012-10-02 11:45 pm (UTC)(link)
The trick is to get the direct URL of the favorite stories page, instead of the iframe "hidden" page that you normally see. What I did was go to the author page, replace www with m (so your browser is forced into mobile layout). Go to the fav stories page and copy that URL, then
- Go to FFDL "Get StoryURLs from Web page" and click OK.
- copy the URLs to clipboard and click OK to close the window.
- Go to FFDL "Add New from URLs"
- watch your Calibre ilbrary fill up.

[identity profile] marilla-pm67.livejournal.com 2012-10-03 07:36 am (UTC)(link)
Oh you are a gem... sorry I didn't see that before I replied ...

Thanks
Sam

[identity profile] marilla-pm67.livejournal.com 2012-10-03 07:33 am (UTC)(link)
Let me check....

I've tried with this : http://www.fanfiction.net/u/1148818/LuvSam (that's me... and choose favorites)
Okay here's an author I like/love : http://www.fanfiction.net/u/409912/Luinlothana - choose fav.

--- Mmh Nope ... that's not cool
it's not a adapter problem it's a ff.net problem, because if you check, the URL it's the same...

Okay if you are using Firefox, I found something useful - I tested it, and it works :)
Here install Link Gopher (https://addons.mozilla.org/en-US/firefox/addon/link-gopher/) once one the author's fav pages right click on the little icon in the bottom right corner of the main windows and choose "Extract Links by Filter".
I choose that filter : http://www.fanfiction.net/s/ and on Luinlothana's fav page I only got all the stories ... then copy, and past it into the Plugin under "Add New URLs" . Please don't use it for hundreds of stories at once, because first it will take a long time in calibre and second, it's a heavy load for ff.net site.

I usually choose 20 max...
If you need a visual help, tell me.


- I think it's not of use because [livejournal.com profile] mremre gave you the answer ....


Sam
Edited 2012-10-03 07:37 (UTC)