Commit Graph

506 Commits (b373fe0eea5a6973432f3bf1bf37101d31e9060f)

Author SHA1 Message Date
Mike Fährmann 37ea66098a
add tests
8 years ago
Mike Fährmann 653885abf2
[doujinmode] remove extractor - site is down
8 years ago
Mike Fährmann 78b168820d
move another 4 extractors
8 years ago
Mike Fährmann 5e82e8dfbd
move chronos & co. to imagehosts file
8 years ago
Mike Fährmann 8b7f719f36
combine imagehost extractors into a single file
8 years ago
Mike Fährmann e6d26f0476
don't overwrite a response's encoding with None
8 years ago
Mike Fährmann e0b3339107
[imgur] match mobile urls (m.imgur.com)
8 years ago
Mike Fährmann 04b1519779
[hitomi] fix domain of image-urls
8 years ago
Mike Fährmann 2004f6bd67
add a few tests
8 years ago
Mike Fährmann 005c539829
improve foolslide volume- and chapter-keywords
8 years ago
Mike Fährmann 2a632c9bfd
[worldthree] add chapter extractor
8 years ago
Mike Fährmann 828aedd571
[khinsider] unescape soundtrack title
8 years ago
Mike Fährmann 3078e4c9f5
[sensescans] add chapter extractor
8 years ago
Mike Fährmann 5374f12bd0
[dokireader] use foolslide base class
8 years ago
Mike Fährmann f4c2461ba7
[powermanga] use foolslide base class
8 years ago
Mike Fährmann e1ce27f41b
add base class for foolslide based sites
8 years ago
Mike Fährmann 46a3f666df
[whentai] add single image extractor
8 years ago
Mike Fährmann a0f56b2c54
update tests
8 years ago
Mike Fährmann f415d4816b
[whentai] add user extractor
8 years ago
Mike Fährmann d793e16463
[nhentai] fix subcategory value
8 years ago
Mike Fährmann 02a441503a
[pinterest] adjust regex pattern
8 years ago
Mike Fährmann a33b13c631
[8chan] fix file urls
8 years ago
Mike Fährmann ffc3c2d32c
[imgbox] transition to https
8 years ago
Mike Fährmann 492cb38391
[exhentai] use image-count as stop signal
8 years ago
Mike Fährmann 607f50effb
[exhentai] retry failed api calls
8 years ago
Mike Fährmann f7c993d952
set 'extension' keyword whenever possible
8 years ago
Mike Fährmann be73af551e
[rapidimg] unset test from parent class
8 years ago
Mike Fährmann 8c8ad08e28
[imgur] fix image url retrieval
8 years ago
Mike Fährmann bf8d88499a
[twitter] add extractor
8 years ago
Mike Fährmann e3926bf351
[hentaihere] add manga- and chapter-extractors
8 years ago
Mike Fährmann c155c7b94b
[hentai2read] put some common code in a base class
8 years ago
Mike Fährmann 277c505b8d
[picmaniac] add extractor
8 years ago
Mike Fährmann a0c044f0c9
[rapidimg] add extractor
8 years ago
Mike Fährmann 883e702fd6
[mangapark] remove 'url' keyword + fix tests
8 years ago
Mike Fährmann c20a3b3a01
[*chan] code cleanup
8 years ago
Mike Fährmann d31ccb16f2
rename 'generic' to 'recursive'
8 years ago
Mike Fährmann 12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
8 years ago
Mike Fährmann 8d106a447c
[tumblr] delete more useless keywords
8 years ago
Mike Fährmann 051c181138
[dokireader] add chapter extractor
8 years ago
Mike Fährmann 1134339c1f
Merge branch 'category'
8 years ago
Mike Fährmann 56d810c896
update keyword hashes for tests
8 years ago
Mike Fährmann 19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
Mike Fährmann 0a3fb198f3
[batoto] raise exception if chapter is unavailable (#4)
8 years ago
Mike Fährmann 3f985d5342
[hitomi] fix some keywords
8 years ago
Mike Fährmann 9d107b8e1b
[dynastyscans] add chapter extractor
8 years ago
Mike Fährmann 975a7cb6b9
[batoto] add (optional) login capabilities
8 years ago
Mike Fährmann e3d156078c
[exhentai] rewrite
8 years ago
Mike Fährmann 49a05c32ed
add missing tests
8 years ago
Mike Fährmann a017cd9e63
[exhentai] metadata consistency
8 years ago
Mike Fährmann fea3be0aed
[nijie] add image-extractor
8 years ago
Mike Fährmann d324c58038
[rule34] add tag- and image-extractor
8 years ago
Mike Fährmann 85ff3d160e
[tumblr] fix json parsing + metadata consistency
8 years ago
Mike Fährmann 80d98f97fa
[hbrowse] add manga extractor
8 years ago
Mike Fährmann 4cb886be78
[turboimagehost] add tests
8 years ago
Mike Fährmann 26a9b7beee
[imagetwist] small fixes + tests
8 years ago
Mike Fährmann a9be82ecc2
[imgbox] small fixes + tests
8 years ago
Mike Fährmann d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
Mike Fährmann 888a988725
[imgchili] workaround for long filenames
8 years ago
Mike Fährmann 155af213a9
[imgtrex] add extractor
8 years ago
Mike Fährmann dbdd43cff5
[imgcandy] add extractor
8 years ago
Mike Fährmann 44a5052302
[coreimg] add extractor
8 years ago
Mike Fährmann dcd213f13e
[nijie] raise NotFoundError
8 years ago
Mike Fährmann 8f6d055deb
[pinterest] raise NotFoundError + tests
8 years ago
Mike Fährmann 517e88680f
[pinterest] add board extractor
8 years ago
Mike Fährmann 79721a65ff
[pinterest] add pin extractor
8 years ago
Mike Fährmann 2afa65cfc7
[imagebam] add single-image extractor
8 years ago
Mike Fährmann 808cf69556
update a few tests
8 years ago
Mike Fährmann 49359d375c
[exhentai] unescape title
8 years ago
Mike Fährmann 95097fac00
[exhentai] transition to https
8 years ago
Mike Fährmann 98877a45fb
[seiga] raise NotFoundError
8 years ago
Mike Fährmann 30d10cf595
[pixiv] fix KeyError if no status is present
8 years ago
Mike Fährmann effa1084f2
[pixiv] raise NotFoundError instead of failing
8 years ago
Mike Fährmann 813320d7db
[seiga] match direct-links to images
8 years ago
Mike Fährmann 85cd7c34b1
[pixiv] match direct-links to images
8 years ago
Mike Fährmann 6d401b1118
precompile regular expressions
8 years ago
Mike Fährmann fa14ef17ea
[imagefap] deal with long filenames
8 years ago
Mike Fährmann 5a5b47e77a
[imagefap] add user extractor
8 years ago
Mike Fährmann d9c5b7a102
[imagefap] add single-image extractor
8 years ago
Mike Fährmann 6792c68254
[seiga] add extractor
8 years ago
Mike Fährmann dac796879a
[imagefap] add extractor
8 years ago
Mike Fährmann 3e8f70188f
[hentaibox] add extractor
8 years ago
Mike Fährmann 5a13ac8e3d
[doujinmode] small fixes + test
8 years ago
Mike Fährmann 25f56c9061
[doujinmode] add extractor
8 years ago
Mike Fährmann a2c5b1e07d
[imgchili] rewrite + single-image extractor
8 years ago
Mike Fährmann 43210391ea
[imgyt] add extractor
8 years ago
Mike Fährmann b9be7f5907
[chronos] fix + test
8 years ago
Mike Fährmann b6a68775d4
[senmanga] add chapter extractor
8 years ago
Mike Fährmann 2faa7393b1
[mangahere] adjust for image domain
8 years ago
Mike Fährmann c2c2e85da3
[imgur] unescape album title + other fixes
8 years ago
Mike Fährmann db1738d451
[luscious] add extractor
8 years ago
Mike Fährmann d01b21c6c8
[nijie] change 'email'-parameter to 'username'
8 years ago
Mike Fährmann f0f7306db6
re-raise async exceptions in main thread
8 years ago
Mike Fährmann 0e20be5a0a
[exhentai] provide username/password auth
8 years ago
Mike Fährmann 0ba9601b63
[nijie] raise AuthError
8 years ago
Mike Fährmann 3136278f79
[pixiv] add option to skip ugoiras
8 years ago
Mike Fährmann 59445c821b
[gelbooru] remove login/auth requirement
8 years ago
Mike Fährmann 221b3869cf
[mangastream] adapt to new page structure
8 years ago
Mike Fährmann d6c06f9efd
add authentication-exception
8 years ago
Mike Fährmann 6f7d42b974
update tests
8 years ago
Mike Fährmann 93c8f6e777
[nhentai] fix json detection
8 years ago
Mike Fährmann 000df8d1fa
add 'encoding' argument for Extractor.request
8 years ago
Mike Fährmann b5e62ec308
[mangastream] adjust regex agein (fixes #2)
9 years ago
Mike Fährmann 2b15b81673
[khinsider] add extractor
9 years ago
Mike Fährmann 0736fe29e2
[mangahere] fix parsing
9 years ago
Mike Fährmann 7af8ae509c
[mangastream] adjust regex
9 years ago
Mike Fährmann 1416e7f6f7
[hentai2read] fix parsing for new page layout
9 years ago
Mike Fährmann c9b7db5af5
[pixiv] code cleanup
9 years ago
Mike Fährmann 10fcc010bb
[nijie] cache login sessions
9 years ago
Mike Fährmann c8e83f6560
[pixiv] cache login sessions
9 years ago
Mike Fährmann 81096f7790
[tumblr] fix json parsing
9 years ago
Mike Fährmann f974ea73db
[tumblr] add tag-extractor
9 years ago
Mike Fährmann 58a0029bb2
[tumblr] add post-extractor
9 years ago
Mike Fährmann 8eb7232169
[tumblr] add extractor
9 years ago
Mike Fährmann 595e5872d3
[hentai2read] add multi-chapter extractor
9 years ago
Mike Fährmann f3dc8851c8
[hentai2read] add a couple more keywords
9 years ago
Mike Fährmann 20228a003f
[hentai2read] add extractor
9 years ago
Mike Fährmann 23a572a20d
[pixiv] update testdata
9 years ago
Mike Fährmann 7f9aeb774e
[powermanga] fix image-urls
9 years ago
Mike Fährmann 5a98be1c45
[nhentai] remove 'favorites' keyword
9 years ago
Mike Fährmann 616e0aedd6
update booru testdata
9 years ago
Mike Fährmann 5a8541afa5
remove 'unstable' tests
9 years ago
Mike Fährmann ba99506c72
more extractor test-cases
9 years ago
Mike Fährmann a99fdb0d1e
[mangapark] fix regexes
9 years ago
Mike Fährmann 2449532132
add more extractor test-cases
9 years ago
Mike Fährmann f0e9e8e0dc
ensure extractors() returns each extractor only once
9 years ago
Mike Fährmann 9c9b1e112a
[imgur] fix 'date' and 'count' keywords
9 years ago
Mike Fährmann 5589bc2ed7
[deviantart] fix non-terminating loop
9 years ago
Mike Fährmann c8fdfbec42
[danbooru] add test cases
9 years ago
Mike Fährmann 5304e5beef
testing environment for extractor results
9 years ago
Mike Fährmann 75ff08f73c
[nijie] proper login and other issues fixed
9 years ago
Mike Fährmann 50ec170b00
[mangapark] add manga extractor
9 years ago
Mike Fährmann 0ff437ca88
[mangapark] add chapter extractor
9 years ago
Mike Fährmann 995d8578bf
[deviantart] fix dates in image-extractor
9 years ago
Mike Fährmann 7d965a2897
[deviantart] add single image extractor
9 years ago
Mike Fährmann e4a661fd6b
[deviantart] fix issue with small images
9 years ago
Mike Fährmann 3ebd126b35
[imgbox] add single image extractor
9 years ago
Mike Fährmann a71805bacf
[chronos] add extractor
9 years ago
Mike Fährmann cb53b29391
[imagetwist] adjust pattern and other fixes
9 years ago
Mike Fährmann 65c8566326
add provisional generic extractor
9 years ago
Mike Fährmann e7512f626d
[turboimagehost] add extractor
9 years ago
Mike Fährmann 56876b76f1
[imagetwist] add extractor
9 years ago
Mike Fährmann bd87b5186d
[spectrumnexus] recognize volumes
9 years ago
Mike Fährmann 2ced575c4a
[spectrumnexus] add manga-extractor
9 years ago
Mike Fährmann f7c47a6018
add subcategories to extractors
9 years ago
Mike Fährmann 81dcfbec90
initial support for extractor-subcategories
9 years ago
Mike Fährmann 1497da07de
remove unused format-strings
9 years ago
Mike Fährmann c23eaccf46
[hentaifoundry] add single image extractor
9 years ago
Mike Fährmann 34210edf9a
[mangashare] add manga-extractor
9 years ago
Mike Fährmann f48712c9c9
docstrings
9 years ago
Mike Fährmann 9cb184d409
[powermanga] support another url-pattern
9 years ago
Mike Fährmann 1eaf0a55a6
[mangamint] add manga-extractor
9 years ago
Mike Fährmann 914062d172
use text.extract_iter where applicable
9 years ago
Mike Fährmann 332d9e393b
[mangahere] support sub-chapters (e.g. ch4.5)
9 years ago
Mike Fährmann 88739a3564
[mangahere] add manga-extractor
9 years ago
Mike Fährmann 2b93fdba7c
[kissmanga] unify extractor metadata in base class
9 years ago
Mike Fährmann 763792f207
[kissmanga] add manga-extractor
9 years ago
Mike Fährmann a1c09ff04d
[mangapanda] fix regex
9 years ago
Mike Fährmann a7243b5ac5
bugfix: add patterns to cache before returning them
9 years ago
Mike Fährmann d8f692f711
[mangapanda] add manga-extractor
9 years ago
Mike Fährmann 63d693866c
[mangareader] remove leading spaces from manga names
9 years ago
Mike Fährmann 20efe49f83
[mangareader] unify extractor metadata in base class
9 years ago
Mike Fährmann d5349c8cb5
[mangareader] add manga-extractor (all chapters)
9 years ago
Mike Fährmann 3a93faa372
add and implement Queue message
9 years ago
Mike Fährmann d1673d912a
[mangahere] add chapter-extractor
9 years ago
Mike Fährmann 8b6f02a615
[mangamint] add chapter extractor
9 years ago
Mike Fährmann 3fb5a8b834
delay 'requests'-import
9 years ago
Mike Fährmann a4c880f4c5
[pixiv] add bookmark extractor
9 years ago
Mike Fährmann daf5fcd416
[pixiv] add user-favorite extractor
9 years ago
Mike Fährmann 20a4782173
[pixiv] get rid of an unnecessry api-call
9 years ago
Mike Fährmann 2a97296e69
[pixiv] add single work/illust extractor
9 years ago
Mike Fährmann 9251ea5771
[powermanga] update to new format
9 years ago
Mike Fährmann 68e7f7427d
Merge branch 'multi-extractor'
9 years ago
Mike Fährmann 4d56b76aa8
update all other extractors
9 years ago
Mike Fährmann ad12180027
[redhawkscans] remove module
9 years ago
Mike Fährmann bcb23e44ce
[powermanga] transfer code from redhawkscans
9 years ago
Mike Fährmann 2dfe97dd00
[chan] update to new format
9 years ago
Mike Fährmann 2d498b19a1
remove 'info' parameter
9 years ago
Mike Fährmann 78234f0572
[safebooru] update to new format
9 years ago
Mike Fährmann bb8f2a3e9d
[gelbooru] update to new format
9 years ago
Mike Fährmann 63a38edd05
[konachan] update to new format
9 years ago
Mike Fährmann 23208a49b8
[e621] update to new format
9 years ago
Mike Fährmann 1bce63124b
[3dbooru] update to new format
9 years ago
Mike Fährmann 70a6599904
[yandere] update to new format
9 years ago
Mike Fährmann 15dec86e6a
[danbooru] update to new format
9 years ago
Mike Fährmann 74199422a8
[booru] add base classes for tag/pool/post extractors
9 years ago
Mike Fährmann 900577b013
restructure info-parameters
9 years ago
Mike Fährmann 205ef3ca02
[danbooru] add single image/post extractor
9 years ago
Mike Fährmann ee1ba22d05
[danbooru] add pool extractor
9 years ago
Mike Fährmann 80917f5392
[danbooru] rewrite to use multiple extractors
9 years ago
Mike Fährmann 8c3783706d
allow multiple extractors per module
9 years ago
Mike Fährmann e9547ebdf3
[exhentai] configurable wait-times
9 years ago
Mike Fährmann 9c63027d2c
[exhentai] fix 'imgkey' handling
9 years ago
Mike Fährmann 4440b40234
[exhentai] better language keywords
9 years ago
Mike Fährmann 1c9296140c
[hitomi] provide proper language keywords
9 years ago
Mike Fährmann 7547d8be3f
[spectrumnexus] add additional regex
9 years ago
Mike Fährmann c2f0720184
code cleanup to use nameext_from_url
9 years ago
Mike Fährmann 41f5971e73
[mangashare] add extractor
9 years ago
Mike Fährmann 3f2fbd874d
[hbrowse] add extractor
9 years ago
Mike Fährmann 783e62b621
[hentaifoundry] code cleanup
9 years ago
Mike Fährmann eb4a87b620
[hentaifoundry] add extractor
9 years ago
Mike Fährmann dd796e91c0
[spectrumnexus] add extractor
9 years ago
Mike Fährmann 73eeed3e72
[imgur] rewrite
9 years ago
Mike Fährmann 4427734b70
[imgur] fix parsing
9 years ago
Mike Fährmann 129ca282e4
[chan] unescape title
9 years ago
Mike Fährmann 3510faaed5
[sankaku] always use correct file-url
9 years ago
Mike Fährmann 3560935318
[exhentai] fix module dicstring
9 years ago
Mike Fährmann 60833abcc6
[sankaku] re-enable extractor
9 years ago
Mike Fährmann 36b376b5ba
[mangastream] add extractor
9 years ago
Mike Fährmann 009761fcd5
[mangapanda] add extractor
9 years ago
Mike Fährmann 5abe32a32c
[kissmanga] fix internal regex
9 years ago
Mike Fährmann 1302f5a0f6
[kissmanga] add extractor
9 years ago
Mike Fährmann 3b0fe8f544
unify booru filename-patterns
9 years ago
Mike Fährmann c05dbd15b5
[gelbooru] support authentication to enable api access
9 years ago
Mike Fährmann 8469b3ae4f
[safebooru] add extractor
9 years ago
Mike Fährmann 6772b54bc4
[konachan] add extractor
9 years ago
Mike Fährmann 8e9bd1d793
sensible output if no extractor found
9 years ago
Mike Fährmann 6ed26864ea
[batoto] rewrite and fix
9 years ago
Mike Fährmann 686a4ddd3e
[8chan] fix file-urls
9 years ago
Mike Fährmann c0efea339e
[imagebam] rewrite/fix
9 years ago
Mike Fährmann e3e754eed7
[imgbox] use text.extract_all
9 years ago
Mike Fährmann 1352187758
[imgth] use text.extract_all
9 years ago
Mike Fährmann 353ac1e00b
[exhentai] use text.extract_all
9 years ago
Mike Fährmann 1fa6a99f18
[mangareader] rewrite
9 years ago
Mike Fährmann cc5e37aeae
[powermanga] adjust regex
9 years ago
Mike Fährmann ec6c1fd18e
[redhawkscans] use langcode to -name mapping
9 years ago
Mike Fährmann 6dcfed16fc
[powermanga] just inherit from redhawkscans
9 years ago
Mike Fährmann d6325865e8
[redhawkscans] generalize to allow subclassing
9 years ago
Mike Fährmann b47f3b9d78 [exhentai] reenable extractor
9 years ago
Mike Fährmann 2472d0722a [hitomi] more metadata
9 years ago
Mike Fährmann 9cfe2c78a5 add extractor 'imgth'
9 years ago
Mike Fährmann 25f48101e5 add extractor 'hitomi'
9 years ago
Mike Fährmann 6ce181bcfe add extractor 'nhentai'
9 years ago
Mike Fährmann cf8f4cd179 [imgur] add to list of extractors
9 years ago
Mike Fährmann c47bb4d570 add extractor 'imgur'
9 years ago
Mike Fährmann 4cb419b5d9 [chan] unescape html entities in title
9 years ago
Mike Fährmann c14b9895ad add extractor 'powermanga'
9 years ago
Mike Fährmann f5d5684119 [pixiv] reuse api-tokens
9 years ago
Mike Fährmann c8e0efe1ff [pixiv] refresh access-token every 50 minutes
9 years ago
Mike Fährmann b8b48ef795 [deviantart] add to extractor list
9 years ago
Mike Fährmann 76f32addf9 [booru] skip images without 'file-url' attribute
9 years ago
Mike Fährmann 0e5ef06ac0 Merge branch 'loader'
9 years ago
Mike Fährmann 733ae601da enable user-specified patterns
9 years ago
Mike Fährmann 49e91bcb73 adjust loader to new config-interface
9 years ago
Mike Fährmann e23aaa4298 Merge branch 'config' into loader
9 years ago
Mike Fährmann 539faa0322 remove SequentialExtractor class
9 years ago
Mike Fährmann 7d7c1afe20 [deviantart] adjust constructor paramters
9 years ago
Mike Fährmann 88442ad26d Merge branch 'config'
9 years ago
Mike Fährmann 3c13548f29 rewrite extractors to use config-module
9 years ago
Mike Fährmann ae535ba0c1 add extractor 'deviantart'
9 years ago
Mike Fährmann 42b8e81a68 rewrite extractors to use text-module
9 years ago