As I was exploring some new stuff added to the recent releases of Visual Studio and .Net 4.6 I came up with the Idea for a programm which I now call the Tumblr All In One Tools.
What this basically is is a heavily multithreaded tumblr crawler and mass downloader with some extra features.
It includes as mentioned a very stable multithreaded crawler based on the tumblr api itself.
The crawler can:
- create a list of all photo-urls found on the blog
- save or load a list of photo-urls
- export the list into a url file readable by Tease Ai
- save or load a list of photo-urls
- download complete crawls with parallel downloading (very fast 2min 40s for ~8k images on 50Mbit)
- download complete crawls image by image (slow ~12min for ~8k images on 50Mbit)
- download specific images
- remove specific images from list by simply pressing the delete key
- export the list into a url file readable by Tease Ai
.This how far I got within the last 2 days. But I won't stop here. You maybe noticed put some Tease Ai support in there and thats the part I though would be worth focussing. As we are all waiting for 1885 to hopefully return and the dicussion came to the conclusion that more cotent creation would be a good thing to focus on now. I think I am able to deploy a tool that can prove very helpful.
My plans are adding a complete and efficient tagging system support for tease ai to directly crawl pictures from tumblr exclude unwanted ones(I will try to make this step much more efficient) then tag them to be ready to be used in tease ai.
I am also open for suggestions
and of course if you find bugs or get the programm to crash just tell me and I will do my best fixing it.Download:
- Spoiler: show
I haven't added sanity checks for user input by now. So please keep the input URL format as following: blogname.tumblr.com
Requirements:
Sadly you will have to install the .net 4.6 framework as the multithreading used relies on recent changes to the library.
So I hope some of you find this useful and like it
q55x8x
