Commit Graph

1109 Commits (f3d770d4e26af4fbc55d004f3708f0e58a5a1907)

Author SHA1 Message Date
Mike Fährmann 07e9e2c4f1
[imgmaid] add extractor
8 years ago
Mike Fährmann 885aa7f7cf
[img4ever] add extractor
8 years ago
Mike Fährmann 5c69a380f0
[kissmanga] code simplifications
8 years ago
Mike Fährmann 4f51d72d22
[imgbox] handle non-existing images/galleries
8 years ago
Mike Fährmann 68fe58ee72
[imgchili] set encoding
8 years ago
Mike Fährmann 58ce0b55e3
[deviantart] make sure to pick the highest quality image
8 years ago
Mike Fährmann 37ea66098a
add tests
8 years ago
Mike Fährmann 653885abf2
[doujinmode] remove extractor - site is down
8 years ago
Mike Fährmann 78b168820d
move another 4 extractors
8 years ago
Mike Fährmann 5e82e8dfbd
move chronos & co. to imagehosts file
8 years ago
Mike Fährmann 8b7f719f36
combine imagehost extractors into a single file
8 years ago
Mike Fährmann e6d26f0476
don't overwrite a response's encoding with None
8 years ago
Mike Fährmann e0b3339107
[imgur] match mobile urls (m.imgur.com)
8 years ago
Mike Fährmann 04b1519779
[hitomi] fix domain of image-urls
8 years ago
Mike Fährmann 2004f6bd67
add a few tests
8 years ago
Mike Fährmann 005c539829
improve foolslide volume- and chapter-keywords
8 years ago
Mike Fährmann 2a632c9bfd
[worldthree] add chapter extractor
8 years ago
Mike Fährmann 91c446805b
replace platform.system() with os.name
8 years ago
Mike Fährmann 828aedd571
[khinsider] unescape soundtrack title
8 years ago
Mike Fährmann 3078e4c9f5
[sensescans] add chapter extractor
8 years ago
Mike Fährmann 5374f12bd0
[dokireader] use foolslide base class
8 years ago
Mike Fährmann f4c2461ba7
[powermanga] use foolslide base class
8 years ago
Mike Fährmann e1ce27f41b
add base class for foolslide based sites
8 years ago
Mike Fährmann 46a3f666df
[whentai] add single image extractor
8 years ago
Mike Fährmann a0f56b2c54
update tests
8 years ago
Mike Fährmann f415d4816b
[whentai] add user extractor
8 years ago
Mike Fährmann d793e16463
[nhentai] fix subcategory value
8 years ago
Mike Fährmann 02a441503a
[pinterest] adjust regex pattern
8 years ago
Mike Fährmann a33b13c631
[8chan] fix file urls
8 years ago
Mike Fährmann ffc3c2d32c
[imgbox] transition to https
8 years ago
Mike Fährmann 492cb38391
[exhentai] use image-count as stop signal
8 years ago
Mike Fährmann 607f50effb
[exhentai] retry failed api calls
8 years ago
Mike Fährmann 691f3d1a02
bump version
8 years ago
Mike Fährmann f434a0711b
put centralized version string in 'version.py'
8 years ago
Mike Fährmann f7c993d952
set 'extension' keyword whenever possible
8 years ago
Mike Fährmann be73af551e
[rapidimg] unset test from parent class
8 years ago
Mike Fährmann 8c8ad08e28
[imgur] fix image url retrieval
8 years ago
Mike Fährmann bf8d88499a
[twitter] add extractor
8 years ago
Mike Fährmann e3926bf351
[hentaihere] add manga- and chapter-extractors
8 years ago
Mike Fährmann c155c7b94b
[hentai2read] put some common code in a base class
8 years ago
Mike Fährmann 0f96eb180e
add Python2 compatible version check
8 years ago
Mike Fährmann 277c505b8d
[picmaniac] add extractor
8 years ago
Mike Fährmann a0c044f0c9
[rapidimg] add extractor
8 years ago
Mike Fährmann 883e702fd6
[mangapark] remove 'url' keyword + fix tests
8 years ago
Mike Fährmann c20a3b3a01
[*chan] code cleanup
8 years ago
Mike Fährmann 14237142d8
use 'format_map()'
8 years ago
Mike Fährmann d31ccb16f2
rename 'generic' to 'recursive'
8 years ago
Mike Fährmann 12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
8 years ago
Mike Fährmann dd8236e733
enable non-standard MIME types
8 years ago
Mike Fährmann 29692c5784
get extension from Content-Type header if not provided
8 years ago
Mike Fährmann 8d106a447c
[tumblr] delete more useless keywords
8 years ago
Mike Fährmann 051c181138
[dokireader] add chapter extractor
8 years ago
Mike Fährmann 1134339c1f
Merge branch 'category'
8 years ago
Mike Fährmann 56d810c896
update keyword hashes for tests
8 years ago
Mike Fährmann 19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
Mike Fährmann f32cf28758
enable long pathnames on windows (#4)
8 years ago
Mike Fährmann 0a3fb198f3
[batoto] raise exception if chapter is unavailable (#4)
8 years ago
Mike Fährmann 2418bfe91b
replace JSONDecodeError with ValueError
8 years ago
Mike Fährmann 581daebc4b
remove trailing spaces from path segments (#4)
8 years ago
Mike Fährmann a347d50ef5
add (sub)category keyword automatically
8 years ago
Mike Fährmann 813317045e
bump version
8 years ago
Mike Fährmann e12862520d
expand path for cache database
8 years ago
Mike Fährmann 3f985d5342
[hitomi] fix some keywords
8 years ago
Mike Fährmann 9d107b8e1b
[dynastyscans] add chapter extractor
8 years ago
Mike Fährmann 975a7cb6b9
[batoto] add (optional) login capabilities
8 years ago
Mike Fährmann e3d156078c
[exhentai] rewrite
8 years ago
Mike Fährmann 49a05c32ed
add missing tests
8 years ago
Mike Fährmann a017cd9e63
[exhentai] metadata consistency
8 years ago
Mike Fährmann fea3be0aed
[nijie] add image-extractor
8 years ago
Mike Fährmann d324c58038
[rule34] add tag- and image-extractor
8 years ago
Mike Fährmann 85ff3d160e
[tumblr] fix json parsing + metadata consistency
8 years ago
Mike Fährmann ba86bbfbdb
add '--list-extractors' argument
8 years ago
Mike Fährmann 80d98f97fa
[hbrowse] add manga extractor
8 years ago
Mike Fährmann 4cb886be78
[turboimagehost] add tests
8 years ago
Mike Fährmann 26a9b7beee
[imagetwist] small fixes + tests
8 years ago
Mike Fährmann a9be82ecc2
[imgbox] small fixes + tests
8 years ago
Mike Fährmann d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
Mike Fährmann 888a988725
[imgchili] workaround for long filenames
8 years ago
Mike Fährmann 155af213a9
[imgtrex] add extractor
8 years ago
Mike Fährmann dbdd43cff5
[imgcandy] add extractor
8 years ago
Mike Fährmann 44a5052302
[coreimg] add extractor
8 years ago
Mike Fährmann dcd213f13e
[nijie] raise NotFoundError
8 years ago
Mike Fährmann 8f6d055deb
[pinterest] raise NotFoundError + tests
8 years ago
Mike Fährmann 517e88680f
[pinterest] add board extractor
8 years ago
Mike Fährmann 79721a65ff
[pinterest] add pin extractor
8 years ago
Mike Fährmann 2afa65cfc7
[imagebam] add single-image extractor
8 years ago
Mike Fährmann 808cf69556
update a few tests
8 years ago
Mike Fährmann 49359d375c
[exhentai] unescape title
8 years ago
Mike Fährmann 95097fac00
[exhentai] transition to https
8 years ago
Mike Fährmann 98877a45fb
[seiga] raise NotFoundError
8 years ago
Mike Fährmann 30d10cf595
[pixiv] fix KeyError if no status is present
8 years ago
Mike Fährmann effa1084f2
[pixiv] raise NotFoundError instead of failing
8 years ago
Mike Fährmann 687478f6f6
new exception + docstrings
8 years ago
Mike Fährmann 813320d7db
[seiga] match direct-links to images
8 years ago
Mike Fährmann 85cd7c34b1
[pixiv] match direct-links to images
8 years ago
Mike Fährmann 143bd9de11
add '--version'
8 years ago
Mike Fährmann 6d401b1118
precompile regular expressions
8 years ago
Mike Fährmann 57a616a36f
update README and bump version
8 years ago
Mike Fährmann fa14ef17ea
[imagefap] deal with long filenames
8 years ago
Mike Fährmann 406add217c
print urls recursively
8 years ago
Mike Fährmann 5a5b47e77a
[imagefap] add user extractor
8 years ago
Mike Fährmann d9c5b7a102
[imagefap] add single-image extractor
8 years ago
Mike Fährmann 6792c68254
[seiga] add extractor
8 years ago
Mike Fährmann dac796879a
[imagefap] add extractor
8 years ago
Mike Fährmann f17e49dcf2
write error messages to stderr
8 years ago
Mike Fährmann 3e8f70188f
[hentaibox] add extractor
8 years ago
Mike Fährmann b0ea9021dc
handle broken pipes
8 years ago
Mike Fährmann 5a13ac8e3d
[doujinmode] small fixes + test
8 years ago
Mike Fährmann 25f56c9061
[doujinmode] add extractor
8 years ago
Mike Fährmann a2c5b1e07d
[imgchili] rewrite + single-image extractor
8 years ago
Mike Fährmann 43210391ea
[imgyt] add extractor
8 years ago
Mike Fährmann b9be7f5907
[chronos] fix + test
8 years ago
Mike Fährmann b6a68775d4
[senmanga] add chapter extractor
8 years ago
Mike Fährmann 2faa7393b1
[mangahere] adjust for image domain
8 years ago
Mike Fährmann c2c2e85da3
[imgur] unescape album title + other fixes
8 years ago
Mike Fährmann db1738d451
[luscious] add extractor
8 years ago
Mike Fährmann 6366ddf154
bump version number
8 years ago
Mike Fährmann 3bcc697853
change default config paths
8 years ago
Mike Fährmann d01b21c6c8
[nijie] change 'email'-parameter to 'username'
8 years ago
Mike Fährmann fe85195023
add --username and --password cmd-line options
8 years ago
Mike Fährmann f0f7306db6
re-raise async exceptions in main thread
8 years ago
Mike Fährmann 0e20be5a0a
[exhentai] provide username/password auth
8 years ago
Mike Fährmann de9aa8f310
better key=value option parsing
8 years ago
Mike Fährmann 0ba9601b63
[nijie] raise AuthError
8 years ago
Mike Fährmann 3136278f79
[pixiv] add option to skip ugoiras
8 years ago
Mike Fährmann 59445c821b
[gelbooru] remove login/auth requirement
8 years ago
Mike Fährmann 221b3869cf
[mangastream] adapt to new page structure
8 years ago
Mike Fährmann d6c06f9efd
add authentication-exception
8 years ago
Mike Fährmann 6f7f29d684
rename a few files
8 years ago
Mike Fährmann 6f7d42b974
update tests
8 years ago
Mike Fährmann 93c8f6e777
[nhentai] fix json detection
8 years ago
Mike Fährmann 000df8d1fa
add 'encoding' argument for Extractor.request
8 years ago
Mike Fährmann 3c94d85409
fix cloudflare bypass
8 years ago
Mike Fährmann b5e62ec308
[mangastream] adjust regex agein (fixes #2)
9 years ago
Mike Fährmann b0c333b799
rewrite cache module
9 years ago
Mike Fährmann 2b15b81673
[khinsider] add extractor
9 years ago
Mike Fährmann 0736fe29e2
[mangahere] fix parsing
9 years ago
Mike Fährmann 7af8ae509c
[mangastream] adjust regex
9 years ago
Mike Fährmann 1416e7f6f7
[hentai2read] fix parsing for new page layout
9 years ago
Mike Fährmann c9b7db5af5
[pixiv] code cleanup
9 years ago
Mike Fährmann 8accf4b790
use cache-decorator for cloudflare bypass
9 years ago
Mike Fährmann 10fcc010bb
[nijie] cache login sessions
9 years ago
Mike Fährmann c8e83f6560
[pixiv] cache login sessions
9 years ago
Mike Fährmann 738c65d54f
add 'keyarg' argument to cache-decorator
9 years ago
Mike Fährmann 81096f7790
[tumblr] fix json parsing
9 years ago
Mike Fährmann b8c6937d39
first draft for a cache-module
9 years ago
Mike Fährmann f974ea73db
[tumblr] add tag-extractor
9 years ago
Mike Fährmann 58a0029bb2
[tumblr] add post-extractor
9 years ago
Mike Fährmann 8eb7232169
[tumblr] add extractor
9 years ago
Mike Fährmann 595e5872d3
[hentai2read] add multi-chapter extractor
9 years ago
Mike Fährmann f3dc8851c8
[hentai2read] add a couple more keywords
9 years ago
Mike Fährmann 20228a003f
[hentai2read] add extractor
9 years ago
Mike Fährmann 23a572a20d
[pixiv] update testdata
9 years ago
Mike Fährmann 7f9aeb774e
[powermanga] fix image-urls
9 years ago
Mike Fährmann 5a98be1c45
[nhentai] remove 'favorites' keyword
9 years ago
Mike Fährmann 8a49a28d13
replace deprecated 'unescape' method
9 years ago
Mike Fährmann 9b46322e70
fix indentation
9 years ago
Mike Fährmann 616e0aedd6
update booru testdata
9 years ago
Mike Fährmann 565ea042c9
update HashJob to generate hashes for downloaded content
9 years ago
Mike Fährmann ecc6542fc8
change required parameter type to file-like objects
9 years ago
Mike Fährmann 5a8541afa5
remove 'unstable' tests
9 years ago
Mike Fährmann ba99506c72
more extractor test-cases
9 years ago
Mike Fährmann a99fdb0d1e
[mangapark] fix regexes
9 years ago
Mike Fährmann 2449532132
add more extractor test-cases
9 years ago
Mike Fährmann f0e9e8e0dc
ensure extractors() returns each extractor only once
9 years ago
Mike Fährmann 9c9b1e112a
[imgur] fix 'date' and 'count' keywords
9 years ago
Mike Fährmann 5589bc2ed7
[deviantart] fix non-terminating loop
9 years ago
Mike Fährmann c8fdfbec42
[danbooru] add test cases
9 years ago
Mike Fährmann 5304e5beef
testing environment for extractor results
9 years ago
Mike Fährmann 9ca4426b72
add HashJob for automated testing
9 years ago
Mike Fährmann 059b1ee5e8
add base class for job types
9 years ago
Mike Fährmann 75ff08f73c
[nijie] proper login and other issues fixed
9 years ago
Mike Fährmann 2dfed4d40a
implement -g,--get-urls option
9 years ago
Mike Fährmann 50ec170b00
[mangapark] add manga extractor
9 years ago
Mike Fährmann 0ff437ca88
[mangapark] add chapter extractor
9 years ago
Mike Fährmann 995d8578bf
[deviantart] fix dates in image-extractor
9 years ago
Mike Fährmann 7d965a2897
[deviantart] add single image extractor
9 years ago
Mike Fährmann e4a661fd6b
[deviantart] fix issue with small images
9 years ago
Mike Fährmann 3ebd126b35
[imgbox] add single image extractor
9 years ago
Mike Fährmann a71805bacf
[chronos] add extractor
9 years ago
Mike Fährmann 30e47848cc
update setup.py and bump version
9 years ago
Mike Fährmann cb53b29391
[imagetwist] adjust pattern and other fixes
9 years ago
Mike Fährmann 65c8566326
add provisional generic extractor
9 years ago
Mike Fährmann e7512f626d
[turboimagehost] add extractor
9 years ago
Mike Fährmann 56876b76f1
[imagetwist] add extractor
9 years ago
Mike Fährmann 810aa4e146
add a space after status indicators
9 years ago
Mike Fährmann b2401542eb
implement output.mode and .shorten options
9 years ago
Mike Fährmann 8d257510d0
rework output module
9 years ago
Mike Fährmann bd87b5186d
[spectrumnexus] recognize volumes
9 years ago
Mike Fährmann 2ced575c4a
[spectrumnexus] add manga-extractor
9 years ago
Mike Fährmann a8c0b4531d
fix issue with Ctrl+c on windows
9 years ago
Mike Fährmann 140f0475a6
allow lists to specify base-dir segments
9 years ago
Mike Fährmann d26eec8470
workarounds for windows console
9 years ago
Mike Fährmann 4b377ccc09
use output-module during downloads
9 years ago
Mike Fährmann c786843a6f
add output-module
9 years ago
Mike Fährmann f7c47a6018
add subcategories to extractors
9 years ago
Mike Fährmann 81dcfbec90
initial support for extractor-subcategories
9 years ago
Mike Fährmann 1146ed95dc
improved get_base_directory
9 years ago
Mike Fährmann 1497da07de
remove unused format-strings
9 years ago
Mike Fährmann c23eaccf46
[hentaifoundry] add single image extractor
9 years ago
Mike Fährmann 34210edf9a
[mangashare] add manga-extractor
9 years ago
Mike Fährmann f48712c9c9
docstrings
9 years ago
Mike Fährmann 9cb184d409
[powermanga] support another url-pattern
9 years ago
Mike Fährmann 1eaf0a55a6
[mangamint] add manga-extractor
9 years ago
Mike Fährmann 914062d172
use text.extract_iter where applicable
9 years ago
Mike Fährmann 99b4fbb081
implement text.extract_iter
9 years ago
Mike Fährmann 332d9e393b
[mangahere] support sub-chapters (e.g. ch4.5)
9 years ago
Mike Fährmann 88739a3564
[mangahere] add manga-extractor
9 years ago
Mike Fährmann e78937a580
cache cookies from cloudflare-bypass
9 years ago
Mike Fährmann 2b93fdba7c
[kissmanga] unify extractor metadata in base class
9 years ago
Mike Fährmann 763792f207
[kissmanga] add manga-extractor
9 years ago
Mike Fährmann a1c09ff04d
[mangapanda] fix regex
9 years ago
Mike Fährmann a7243b5ac5
bugfix: add patterns to cache before returning them
9 years ago
Mike Fährmann d8f692f711
[mangapanda] add manga-extractor
9 years ago
Mike Fährmann 63d693866c
[mangareader] remove leading spaces from manga names
9 years ago
Mike Fährmann 20efe49f83
[mangareader] unify extractor metadata in base class
9 years ago
Mike Fährmann d5349c8cb5
[mangareader] add manga-extractor (all chapters)
9 years ago
Mike Fährmann 3a93faa372
add and implement Queue message
9 years ago
Mike Fährmann d96f4f8299
bump version
9 years ago
Mike Fährmann d1673d912a
[mangahere] add chapter-extractor
9 years ago
Mike Fährmann 8b6f02a615
[mangamint] add chapter extractor
9 years ago
Mike Fährmann 3fb5a8b834
delay 'requests'-import
9 years ago
Mike Fährmann a4c880f4c5
[pixiv] add bookmark extractor
9 years ago
Mike Fährmann daf5fcd416
[pixiv] add user-favorite extractor
9 years ago
Mike Fährmann 20a4782173
[pixiv] get rid of an unnecessry api-call
9 years ago
Mike Fährmann 2a97296e69
[pixiv] add single work/illust extractor
9 years ago
Mike Fährmann 9251ea5771
[powermanga] update to new format
9 years ago
Mike Fährmann 68e7f7427d
Merge branch 'multi-extractor'
9 years ago
Mike Fährmann c0aaf230d5
remove comments
9 years ago
Mike Fährmann 4d56b76aa8
update all other extractors
9 years ago
Mike Fährmann ad12180027
[redhawkscans] remove module
9 years ago
Mike Fährmann bcb23e44ce
[powermanga] transfer code from redhawkscans
9 years ago
Mike Fährmann 2dfe97dd00
[chan] update to new format
9 years ago
Mike Fährmann 2d498b19a1
remove 'info' parameter
9 years ago
Mike Fährmann 78234f0572
[safebooru] update to new format
9 years ago
Mike Fährmann bb8f2a3e9d
[gelbooru] update to new format
9 years ago
Mike Fährmann 63a38edd05
[konachan] update to new format
9 years ago
Mike Fährmann 23208a49b8
[e621] update to new format
9 years ago
Mike Fährmann 1bce63124b
[3dbooru] update to new format
9 years ago
Mike Fährmann 70a6599904
[yandere] update to new format
9 years ago
Mike Fährmann 15dec86e6a
[danbooru] update to new format
9 years ago
Mike Fährmann 74199422a8
[booru] add base classes for tag/pool/post extractors
9 years ago
Mike Fährmann 900577b013
restructure info-parameters
9 years ago
Mike Fährmann 205ef3ca02
[danbooru] add single image/post extractor
9 years ago
Mike Fährmann ee1ba22d05
[danbooru] add pool extractor
9 years ago
Mike Fährmann 80917f5392
[danbooru] rewrite to use multiple extractors
9 years ago
Mike Fährmann 8c3783706d
allow multiple extractors per module
9 years ago
Mike Fährmann e9547ebdf3
[exhentai] configurable wait-times
9 years ago
Mike Fährmann 9c63027d2c
[exhentai] fix 'imgkey' handling
9 years ago
Mike Fährmann 4440b40234
[exhentai] better language keywords
9 years ago
Mike Fährmann 1c9296140c
[hitomi] provide proper language keywords
9 years ago
Mike Fährmann 7fd284a705
always provide lowercase fileextensions
9 years ago
Mike Fährmann 7547d8be3f
[spectrumnexus] add additional regex
9 years ago
Mike Fährmann c2f0720184
code cleanup to use nameext_from_url
9 years ago
Mike Fährmann ca523b9f64
add helper method to text module
9 years ago
Mike Fährmann 41f5971e73
[mangashare] add extractor
9 years ago
Mike Fährmann 3f2fbd874d
[hbrowse] add extractor
9 years ago
Mike Fährmann 5db2aa29cf
Merge branch 'options'
9 years ago
Mike Fährmann b55870909c
properly implement -c,--config option
9 years ago
Mike Fährmann b683427d42
properly implement -d,--dest options
9 years ago
Mike Fährmann b041906c2c make URL argument not necessary for some switches
9 years ago
Mike Fährmann fdcc434b3d
implement --list-modules cmd-line option
9 years ago
Mike Fährmann 783e62b621
[hentaifoundry] code cleanup
9 years ago
Mike Fährmann eb4a87b620
[hentaifoundry] add extractor
9 years ago
Mike Fährmann 247c5fcf8f
Merge branch 'options'
9 years ago
Mike Fährmann 90247977c9
implement --list-keywords cmd-line option
9 years ago
Mike Fährmann edf3f7b69f
add KeywordJob class
9 years ago
Mike Fährmann dd796e91c0
[spectrumnexus] add extractor
9 years ago
Mike Fährmann db113bd87d
rename download.py
9 years ago
Mike Fährmann 47f016a016
remove DownloadManager class
9 years ago
Mike Fährmann 352950eebe
new method to import downloaders
9 years ago
Mike Fährmann 21a6416737
bugfixes
9 years ago
Mike Fährmann 73eeed3e72
[imgur] rewrite
9 years ago
Mike Fährmann 4427734b70
[imgur] fix parsing
9 years ago
Mike Fährmann 129ca282e4
[chan] unescape title
9 years ago
Mike Fährmann 20845d86f8
bump version
9 years ago
Mike Fährmann 3eaae19345
cmd line switch to set options
9 years ago
Mike Fährmann 3510faaed5
[sankaku] always use correct file-url
9 years ago
Mike Fährmann 3560935318
[exhentai] fix module dicstring
9 years ago
Mike Fährmann 60833abcc6
[sankaku] re-enable extractor
9 years ago
Mike Fährmann 36b376b5ba
[mangastream] add extractor
9 years ago
Mike Fährmann 009761fcd5
[mangapanda] add extractor
9 years ago
Mike Fährmann 5abe32a32c
[kissmanga] fix internal regex
9 years ago
Mike Fährmann 079330785a
document and fix smaller bugs
9 years ago
Mike Fährmann 1302f5a0f6
[kissmanga] add extractor
9 years ago
Mike Fährmann 822527a2ce
module to bypass cloudflare protection
9 years ago
Mike Fährmann 3b0fe8f544
unify booru filename-patterns
9 years ago
Mike Fährmann c05dbd15b5
[gelbooru] support authentication to enable api access
9 years ago
Mike Fährmann 8469b3ae4f
[safebooru] add extractor
9 years ago
Mike Fährmann 6772b54bc4
[konachan] add extractor
9 years ago
Mike Fährmann 8e9bd1d793
sensible output if no extractor found
9 years ago
Mike Fährmann 6e67935b59
add more languages to iso639-1 dict
9 years ago
Mike Fährmann 6ed26864ea
[batoto] rewrite and fix
9 years ago
Mike Fährmann 686a4ddd3e
[8chan] fix file-urls
9 years ago
Mike Fährmann 950bebfd57
update setup.py and bump version
9 years ago
Mike Fährmann c0efea339e
[imagebam] rewrite/fix
9 years ago
Mike Fährmann e3e754eed7
[imgbox] use text.extract_all
9 years ago
Mike Fährmann 1352187758
[imgth] use text.extract_all
9 years ago
Mike Fährmann 353ac1e00b
[exhentai] use text.extract_all
9 years ago
Mike Fährmann 1fa6a99f18
[mangareader] rewrite
9 years ago
Mike Fährmann d0bebd9ce3
allow adding values to existing dict
9 years ago
Mike Fährmann 629133a27a
document text.extract
9 years ago
Mike Fährmann 692d0c95cc
reimplement text.extract_all
9 years ago
Mike Fährmann 506242740f
fix capitalization issues
9 years ago
Mike Fährmann cc5e37aeae
[powermanga] adjust regex
9 years ago
Mike Fährmann ec6c1fd18e
[redhawkscans] use langcode to -name mapping
9 years ago
Mike Fährmann b24bb1da7d
new module for simple language code to name mapping
9 years ago
Mike Fährmann 6dcfed16fc
[powermanga] just inherit from redhawkscans
9 years ago
Mike Fährmann d6325865e8
[redhawkscans] generalize to allow subclassing
9 years ago
Mike Fährmann b47f3b9d78 [exhentai] reenable extractor
9 years ago
Mike Fährmann db479f881d implement text.shorten_path/filename methods
9 years ago
Mike Fährmann 882b1f31b1 update setup.py and bump version
9 years ago
Mike Fährmann 2472d0722a [hitomi] more metadata
9 years ago
Mike Fährmann 9cfe2c78a5 add extractor 'imgth'
9 years ago
Mike Fährmann 25f48101e5 add extractor 'hitomi'
9 years ago
Mike Fährmann 6ce181bcfe add extractor 'nhentai'
9 years ago
Mike Fährmann cf8f4cd179 [imgur] add to list of extractors
9 years ago
Mike Fährmann c47bb4d570 add extractor 'imgur'
9 years ago
Mike Fährmann 89f938ee55 handle non string-like arguemnts for clean_path
9 years ago
Mike Fährmann 4cb419b5d9 [chan] unescape html entities in title
9 years ago
Mike Fährmann 7b83f88c64 replace illegal characters in paths
9 years ago
Mike Fährmann c14b9895ad add extractor 'powermanga'
9 years ago
Mike Fährmann f5d5684119 [pixiv] reuse api-tokens
9 years ago
Mike Fährmann bea33ae9cb implement config.setdefault
9 years ago
Mike Fährmann c8e0efe1ff [pixiv] refresh access-token every 50 minutes
9 years ago
Mike Fährmann e37846e1c1 bump version number
9 years ago
Mike Fährmann b8b48ef795 [deviantart] add to extractor list
9 years ago
Mike Fährmann 76f32addf9 [booru] skip images without 'file-url' attribute
9 years ago
Mike Fährmann 0e5ef06ac0 Merge branch 'loader'
9 years ago
Mike Fährmann 733ae601da enable user-specified patterns
9 years ago
Mike Fährmann 49e91bcb73 adjust loader to new config-interface
9 years ago
Mike Fährmann e23aaa4298 Merge branch 'config' into loader
9 years ago
Mike Fährmann 539faa0322 remove SequentialExtractor class
9 years ago
Mike Fährmann 7d7c1afe20 [deviantart] adjust constructor paramters
9 years ago
Mike Fährmann 88442ad26d Merge branch 'config'
9 years ago
Mike Fährmann 3c13548f29 rewrite extractors to use config-module
9 years ago
Mike Fährmann 608d3193a9 use new config-module in downloader
9 years ago
Mike Fährmann 2026223ed1 change argument format for config-calls
9 years ago
Mike Fährmann ae535ba0c1 add extractor 'deviantart'
9 years ago
Mike Fährmann 9986a5ffb5 json-based config module
9 years ago
Mike Fährmann 42b8e81a68 rewrite extractors to use text-module
9 years ago
Mike Fährmann c5801c9770 combine text related functions in new module
9 years ago
Mike Fährmann d7e0d81bdd [8chan] use api
9 years ago
Mike Fährmann d8ef128e74 [4chan] update default filename and directory
9 years ago
Mike Fährmann 1998ec9b13 [pixiv] update user-agent to newest version
9 years ago
Mike Fährmann c9ef181b3c [4chan] use api
9 years ago
Mike Fährmann c8e5b2e89e base class for futaba-chan boards with api
9 years ago
Mike Fährmann 26bb9d62de move and rework extractor-loading code
9 years ago
Mike Fährmann 4348694629 sanatize output
9 years ago
Mike Fährmann 63992363a6 [pixiv] handle timestamps at the end of urls
9 years ago
Mike Fährmann 13ebca2a48 [mangareader] supply correct width and height
9 years ago
Mike Fährmann 2afe15b217 [redhawkscans] let requests handle content decoding
9 years ago
Mike Fährmann 675937c77c [mangareader] add extractor
9 years ago
Mike Fährmann 58dfd1a38f [redhawkscans] fix chapter parsing
9 years ago
Mike Fährmann a9e68c2745 [redhawkscans] fix json extraction
9 years ago
Mike Fährmann b3f656ffd5 [redhawkscans] add extractor
9 years ago
Mike Fährmann d9d88f1448 [pixiv] fix ugoira parsing
9 years ago
Mike Fährmann 68c4306040 [pixiv] transition to pixiv public api
9 years ago
Mike Fährmann c0530a635c [batoto] a few fixes
10 years ago
Mike Fährmann a145a73d05 add extractor 'nijie'
10 years ago
Mike Fährmann 9c25c15438 [3dbooru] fix default regex
10 years ago
Mike Fährmann 5993177ae3 [4chan] more metadata entries (size, width, height)
10 years ago
Mike Fährmann a2cfbe445f add extractor '3dbooru'
10 years ago
Mike Fährmann 762ad7426a add extractor 'yandere'
10 years ago
Mike Fährmann 07f23dc2fa add extractor '4chan'
10 years ago
Mike Fährmann fae1b28c48 [pixiv] fix parsing of illust_ids
10 years ago
Mike Fährmann ffec41f352 [imgchili] update to new extractor interface
10 years ago
Mike Fährmann f3e208c0ab [batoto] update to new extractor interface
10 years ago
Mike Fährmann 3c6161eea7 small whitespace fixes
10 years ago
Mike Fährmann 593a29b677 [imgbox] update to new extractor interface
10 years ago
Mike Fährmann e41768d969 [imagebam] update to new extractor interface
10 years ago
Mike Fährmann 758fe00441 [e621] update to new extractor interface
10 years ago
Mike Fährmann 5cb46a2cb3 [gelbooru] update to new extractor interface
10 years ago
Mike Fährmann 1f4866fcd6 [danbooru] update to new extractor interface
10 years ago
Mike Fährmann 8c7da93d19 move and update BooruExtractor classes
10 years ago
Mike Fährmann 28fa7c53b4 docstrings and other small fixes for downloaders
10 years ago
Mike Fährmann 5545624da1 use seperate session in http downloader
10 years ago
Mike Fährmann 8f24329e30 [pixiv] fix http headers and cookies
10 years ago
Mike Fährmann 5806e02f97 better support for KeyboardInterrupt exceptions
10 years ago
Mike Fährmann 1cd25b5369 [pixiv] update to new extractor interface
10 years ago
Mike Fährmann 7c8d787077 add a few docstrings
10 years ago
Mike Fährmann 30b9db43a0 [8chan] combine patterns
10 years ago
Mike Fährmann 3872ccb435 pylint fixes
10 years ago
Mike Fährmann ce2fab9c7e allow user-specified formats for filenames
10 years ago
Mike Fährmann 652d60a5cd implement new extractor-module selection
10 years ago
Mike Fährmann cd4a699dd2 add 'Headers' and 'Cookies' message
10 years ago
Mike Fährmann 7b9fcea6bb small fixes
10 years ago
Mike Fährmann f31c05f522 [8chan] update to new extractor interface
10 years ago
Mike Fährmann 0abbee3710 update download-infrastructure
10 years ago
Mike Fährmann 513808d156 move code from util.py
10 years ago
Mike Fährmann 41f00809ff update extractor base classes
10 years ago
Mike Fährmann 63bf0d1725 update __init__.py
10 years ago
Mike Fährmann 7c12ba1c31 move DownloadManager and ExtractorFinder
10 years ago
Mike Fährmann d13608e909 [pixiv] fix parsing of illust-ids
10 years ago
Mike Fährmann a66a5099f8 added extractor 'imgchili'
10 years ago
Mike Fährmann ac002cc4b3 [8chan] fix image urls
10 years ago
Mike Fährmann 54d40b85fb [pixiv] load balancing for image servers
10 years ago
Mike Fährmann 0f6cc964cc [8chan] use new domainname for thread-urls
10 years ago
Mike Fährmann 34d13bc906 added extractor 'danbooru' + split BooruExtractor to handle XML and JSON
10 years ago
Mike Fährmann 2a7dbd8868 [booru] unquote tags to fix multiple tags in urls
10 years ago
Mike Fährmann 099fe7515e added extractor 'e621'
10 years ago
Mike Fährmann 1244c933a1 [8chan] fix image urls
10 years ago
Mike Fährmann 729d2d8b20 [imagebam] fixed issue with destination direcotry name
10 years ago
Mike Fährmann 98dd5f9a90 added extractor 'imagebam'
10 years ago
Mike Fährmann ff53b7f6fa added extractor 'imgbox'
10 years ago
Mike Fährmann 4950cb0ab9 use 'safe_request' to handle connection errors
10 years ago
Mike Fährmann b630753e5e add 'method' parameter
10 years ago
Mike Fährmann 7588974306 fixed various bugs
10 years ago
Mike Fährmann deef91eddc initial commit
10 years ago