Mike Fährmann
8e93633319
[nhentai] fix image urls
8 years ago
Mike Fährmann
d82508f245
fix tests for turboimagehost and pinterest
8 years ago
Mike Fährmann
3434c5a026
[pinterest] add support for pin.it URLs
8 years ago
Mike Fährmann
37d4d07d9b
compatibility fixes to make a standalone exe work
8 years ago
Mike Fährmann
4553a6392f
[whentai] add unittests
8 years ago
Mike Fährmann
434ef4d5a2
[mangafox] raise proper exception if chapter is not available
8 years ago
Mike Fährmann
98fa5cf2fa
[mangafox] add chapter extractor
8 years ago
Mike Fährmann
cc0b4f2661
[yomanga] add chapter extractor
8 years ago
Mike Fährmann
ad4b02508f
trying to understand travis-ci unit test failures
...
- added some debug output via logging module
- unit tests work on my machine (tm)
8 years ago
Mike Fährmann
72d3ca0bf9
[deviantart] use API for user-extractor
8 years ago
Mike Fährmann
00074a71d7
several changes to make travis build work
...
- fixed html.unescape not being available on Python3.3
- removed inconsistent test result
- added username/password pairs for authenticating extractors
8 years ago
Mike Fährmann
cfe5bf732a
[gomanga] add chapter extractor
8 years ago
Mike Fährmann
4a8d74973c
adjust login methods to a specific style
8 years ago
Mike Fährmann
98d6d131a3
update unittests for batoto and yonkouprod
8 years ago
Mike Fährmann
468c9aeeec
make tests more reliable
8 years ago
Mike Fährmann
33c799b2ae
[yonkouprod] rename 'yonkou' to 'yonkouprod'
8 years ago
Mike Fährmann
95986ed566
[seiga] add user extractor
8 years ago
Mike Fährmann
efaba5f398
[luscious] support new album URLs + small fixes
8 years ago
Mike Fährmann
79ea457e24
[luscious] use new 'html' attribute in API responses
8 years ago
Mike Fährmann
a8d716c043
[pinterest] tests + fix error message
8 years ago
Mike Fährmann
a849d8f2f7
add a few more tests
8 years ago
Mike Fährmann
7952b8d18d
add a few tests expecting exceptions
8 years ago
Mike Fährmann
efdc299547
[hentaifoundry] get artist name from webpage
8 years ago
Mike Fährmann
1aeb60d997
[jaiminisbox] add extractor
8 years ago
Mike Fährmann
8b2024a1a5
[hentaifoundry] support direct links to images
8 years ago
Mike Fährmann
c604a65b88
[imgyt] use token as filename if none is given
8 years ago
Mike Fährmann
3a7421a6ce
[twitter] get 'original' instead of 'large' image
8 years ago
Mike Fährmann
cb180507ab
[batoto] add manga extractor
8 years ago
Mike Fährmann
ff2a65d5c1
[exhentai] raise proper exception for 'unavailable' galleries
8 years ago
Mike Fährmann
f69209871d
[kisscomic] change some names from 'manga' to 'comic'
8 years ago
Mike Fährmann
d623b9bfdc
[readcomics] code cleanup + tests
8 years ago
Mike Fährmann
c19241e299
[readcomics] add comic extractor
8 years ago
Mike Fährmann
179d62023c
[readcomics] add comic-issue extractor
8 years ago
Mike Fährmann
d12a04af3c
[test] filter out classes without a 'test' attribute
8 years ago
Mike Fährmann
40dbea7ed2
rewrite parts of the cloudflare bypass system
8 years ago
Mike Fährmann
3c4155c9c9
[kisscomic] add extractors
8 years ago
Mike Fährmann
06c798d18e
[yonkou] add chapter extracter
8 years ago
Mike Fährmann
effdf9c3be
[luscious] adapt to API changes
8 years ago
Mike Fährmann
4c55275305
update tests
8 years ago
Mike Fährmann
69cde97c93
add utility extractor that runs test-URLs
8 years ago
Mike Fährmann
b0e8daf415
[imgclick] remove extractor - uses captcha
8 years ago
Mike Fährmann
0211ec4114
update some tests
8 years ago
Mike Fährmann
dfd1992a2c
[hentaifoundry] small updates
...
- throw an exception if an user or image does not exist
- update tests, since the user of the old ones left
8 years ago
Mike Fährmann
2fae0b1803
[fapat] add extractor
8 years ago
Mike Fährmann
583f1b8bbb
[postimg] add extractor
8 years ago
Mike Fährmann
d1cd9acf54
[pixhost] adjust to new site layout
8 years ago
Mike Fährmann
0989cd2430
add basic support for file:// URLs
...
this allows you to feed local files into the recursive extractor
8 years ago
Mike Fährmann
91dff9827f
[luscious] always provide URLs to the original images
8 years ago
Mike Fährmann
d402e644bf
update tests
8 years ago
Mike Fährmann
46440fda2d
[imagevenue] add extractor
8 years ago
Mike Fährmann
2449825d53
[kissmanga] solve cloudflare challenge on demand
8 years ago
Mike Fährmann
9e3788175e
implement decorator for cloudflare bypass
...
this method for enabling and caching a cloudflare bypass for a
requests.session object allows for different cache-timeouts for
different domains
8 years ago
Mike Fährmann
6e98538d36
[mangamint] small fixes and additions
...
- force https
- update patterns to also catch non-standard URLs to manga and chapters
- handle URLs to non-existing resources gracefully
- fix terminating condition for chapter listings
- add a base class for common code
- add and update tests
8 years ago
Mike Fährmann
c333bc33e3
[mangapark] small fixes and additions
...
- add a 'title' keyword for chapter-titles and update the directory
format accordingly
- add a 'type' keyword to distinguish between manga and manhwa
- fix an issue where an exception would be thrown if a chapter number
did not have any special additions (2.5, 55a, v2, etc.)
- add a test-case without a special chapter number
- unescape manga title
8 years ago
Mike Fährmann
b634ace39e
[readcomiconline] add comic-issue and comic extractor
8 years ago
Mike Fährmann
99440ca51a
[imgtrial] add extractor
8 years ago
Mike Fährmann
5f2824dfe6
[imgspot] add extractor
8 years ago
Mike Fährmann
c85adbdc9d
[mangamint] code simplifications
8 years ago
Mike Fährmann
88193718e8
[pixhost] add extractor
8 years ago
Mike Fährmann
07e9e2c4f1
[imgmaid] add extractor
8 years ago
Mike Fährmann
885aa7f7cf
[img4ever] add extractor
8 years ago
Mike Fährmann
5c69a380f0
[kissmanga] code simplifications
8 years ago
Mike Fährmann
4f51d72d22
[imgbox] handle non-existing images/galleries
8 years ago
Mike Fährmann
68fe58ee72
[imgchili] set encoding
8 years ago
Mike Fährmann
58ce0b55e3
[deviantart] make sure to pick the highest quality image
8 years ago
Mike Fährmann
37ea66098a
add tests
8 years ago
Mike Fährmann
653885abf2
[doujinmode] remove extractor - site is down
8 years ago
Mike Fährmann
78b168820d
move another 4 extractors
8 years ago
Mike Fährmann
5e82e8dfbd
move chronos & co. to imagehosts file
8 years ago
Mike Fährmann
8b7f719f36
combine imagehost extractors into a single file
...
added extractors for
- hosturimage.com
- imageontime.org
- imgupload.yt
- imgspice.com
- imgclick.net
All of these would have shared a lot of common code, so i created a base
class for imagehost extractors and put them all in the same file to
avoid clutter.
8 years ago
Mike Fährmann
e6d26f0476
don't overwrite a response's encoding with None
8 years ago
Mike Fährmann
e0b3339107
[imgur] match mobile urls (m.imgur.com)
8 years ago
Mike Fährmann
04b1519779
[hitomi] fix domain of image-urls
8 years ago
Mike Fährmann
2004f6bd67
add a few tests
8 years ago
Mike Fährmann
005c539829
improve foolslide volume- and chapter-keywords
8 years ago
Mike Fährmann
2a632c9bfd
[worldthree] add chapter extractor
8 years ago
Mike Fährmann
828aedd571
[khinsider] unescape soundtrack title
8 years ago
Mike Fährmann
3078e4c9f5
[sensescans] add chapter extractor
8 years ago
Mike Fährmann
5374f12bd0
[dokireader] use foolslide base class
8 years ago
Mike Fährmann
f4c2461ba7
[powermanga] use foolslide base class
8 years ago
Mike Fährmann
e1ce27f41b
add base class for foolslide based sites
8 years ago
Mike Fährmann
46a3f666df
[whentai] add single image extractor
8 years ago
Mike Fährmann
a0f56b2c54
update tests
8 years ago
Mike Fährmann
f415d4816b
[whentai] add user extractor
8 years ago
Mike Fährmann
d793e16463
[nhentai] fix subcategory value
8 years ago
Mike Fährmann
02a441503a
[pinterest] adjust regex pattern
8 years ago
Mike Fährmann
a33b13c631
[8chan] fix file urls
8 years ago
Mike Fährmann
ffc3c2d32c
[imgbox] transition to https
8 years ago
Mike Fährmann
492cb38391
[exhentai] use image-count as stop signal
8 years ago
Mike Fährmann
607f50effb
[exhentai] retry failed api calls
8 years ago
Mike Fährmann
f7c993d952
set 'extension' keyword whenever possible
8 years ago
Mike Fährmann
be73af551e
[rapidimg] unset test from parent class
8 years ago
Mike Fährmann
8c8ad08e28
[imgur] fix image url retrieval
8 years ago
Mike Fährmann
bf8d88499a
[twitter] add extractor
8 years ago
Mike Fährmann
e3926bf351
[hentaihere] add manga- and chapter-extractors
8 years ago
Mike Fährmann
c155c7b94b
[hentai2read] put some common code in a base class
8 years ago
Mike Fährmann
277c505b8d
[picmaniac] add extractor
8 years ago
Mike Fährmann
a0c044f0c9
[rapidimg] add extractor
8 years ago
Mike Fährmann
883e702fd6
[mangapark] remove 'url' keyword + fix tests
8 years ago
Mike Fährmann
c20a3b3a01
[*chan] code cleanup
8 years ago
Mike Fährmann
d31ccb16f2
rename 'generic' to 'recursive'
8 years ago
Mike Fährmann
12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
8 years ago
Mike Fährmann
8d106a447c
[tumblr] delete more useless keywords
8 years ago
Mike Fährmann
051c181138
[dokireader] add chapter extractor
8 years ago
Mike Fährmann
1134339c1f
Merge branch 'category'
8 years ago
Mike Fährmann
56d810c896
update keyword hashes for tests
8 years ago
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
Mike Fährmann
0a3fb198f3
[batoto] raise exception if chapter is unavailable ( #4 )
8 years ago
Mike Fährmann
3f985d5342
[hitomi] fix some keywords
8 years ago
Mike Fährmann
9d107b8e1b
[dynastyscans] add chapter extractor
8 years ago
Mike Fährmann
975a7cb6b9
[batoto] add (optional) login capabilities
8 years ago
Mike Fährmann
e3d156078c
[exhentai] rewrite
8 years ago
Mike Fährmann
49a05c32ed
add missing tests
8 years ago
Mike Fährmann
a017cd9e63
[exhentai] metadata consistency
8 years ago
Mike Fährmann
fea3be0aed
[nijie] add image-extractor
8 years ago
Mike Fährmann
d324c58038
[rule34] add tag- and image-extractor
8 years ago
Mike Fährmann
85ff3d160e
[tumblr] fix json parsing + metadata consistency
8 years ago
Mike Fährmann
80d98f97fa
[hbrowse] add manga extractor
8 years ago
Mike Fährmann
4cb886be78
[turboimagehost] add tests
8 years ago
Mike Fährmann
26a9b7beee
[imagetwist] small fixes + tests
8 years ago
Mike Fährmann
a9be82ecc2
[imgbox] small fixes + tests
8 years ago
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
Mike Fährmann
888a988725
[imgchili] workaround for long filenames
8 years ago
Mike Fährmann
155af213a9
[imgtrex] add extractor
8 years ago
Mike Fährmann
dbdd43cff5
[imgcandy] add extractor
8 years ago
Mike Fährmann
44a5052302
[coreimg] add extractor
8 years ago
Mike Fährmann
dcd213f13e
[nijie] raise NotFoundError
8 years ago
Mike Fährmann
8f6d055deb
[pinterest] raise NotFoundError + tests
8 years ago
Mike Fährmann
517e88680f
[pinterest] add board extractor
8 years ago
Mike Fährmann
79721a65ff
[pinterest] add pin extractor
8 years ago
Mike Fährmann
2afa65cfc7
[imagebam] add single-image extractor
8 years ago
Mike Fährmann
808cf69556
update a few tests
8 years ago
Mike Fährmann
49359d375c
[exhentai] unescape title
8 years ago
Mike Fährmann
95097fac00
[exhentai] transition to https
8 years ago
Mike Fährmann
98877a45fb
[seiga] raise NotFoundError
8 years ago
Mike Fährmann
30d10cf595
[pixiv] fix KeyError if no status is present
8 years ago
Mike Fährmann
effa1084f2
[pixiv] raise NotFoundError instead of failing
8 years ago
Mike Fährmann
813320d7db
[seiga] match direct-links to images
8 years ago
Mike Fährmann
85cd7c34b1
[pixiv] match direct-links to images
8 years ago
Mike Fährmann
6d401b1118
precompile regular expressions
8 years ago
Mike Fährmann
fa14ef17ea
[imagefap] deal with long filenames
8 years ago
Mike Fährmann
5a5b47e77a
[imagefap] add user extractor
8 years ago
Mike Fährmann
d9c5b7a102
[imagefap] add single-image extractor
8 years ago
Mike Fährmann
6792c68254
[seiga] add extractor
8 years ago
Mike Fährmann
dac796879a
[imagefap] add extractor
8 years ago
Mike Fährmann
3e8f70188f
[hentaibox] add extractor
8 years ago
Mike Fährmann
5a13ac8e3d
[doujinmode] small fixes + test
8 years ago
Mike Fährmann
25f56c9061
[doujinmode] add extractor
8 years ago
Mike Fährmann
a2c5b1e07d
[imgchili] rewrite + single-image extractor
8 years ago
Mike Fährmann
43210391ea
[imgyt] add extractor
8 years ago
Mike Fährmann
b9be7f5907
[chronos] fix + test
8 years ago
Mike Fährmann
b6a68775d4
[senmanga] add chapter extractor
8 years ago
Mike Fährmann
2faa7393b1
[mangahere] adjust for image domain
8 years ago
Mike Fährmann
c2c2e85da3
[imgur] unescape album title + other fixes
8 years ago
Mike Fährmann
db1738d451
[luscious] add extractor
8 years ago
Mike Fährmann
d01b21c6c8
[nijie] change 'email'-parameter to 'username'
8 years ago
Mike Fährmann
f0f7306db6
re-raise async exceptions in main thread
8 years ago
Mike Fährmann
0e20be5a0a
[exhentai] provide username/password auth
8 years ago
Mike Fährmann
0ba9601b63
[nijie] raise AuthError
8 years ago
Mike Fährmann
3136278f79
[pixiv] add option to skip ugoiras
8 years ago
Mike Fährmann
59445c821b
[gelbooru] remove login/auth requirement
8 years ago
Mike Fährmann
221b3869cf
[mangastream] adapt to new page structure
8 years ago
Mike Fährmann
d6c06f9efd
add authentication-exception
8 years ago
Mike Fährmann
6f7d42b974
update tests
8 years ago
Mike Fährmann
93c8f6e777
[nhentai] fix json detection
8 years ago
Mike Fährmann
000df8d1fa
add 'encoding' argument for Extractor.request
8 years ago
Mike Fährmann
b5e62ec308
[mangastream] adjust regex agein ( fixes #2 )
9 years ago
Mike Fährmann
2b15b81673
[khinsider] add extractor
9 years ago
Mike Fährmann
0736fe29e2
[mangahere] fix parsing
9 years ago
Mike Fährmann
7af8ae509c
[mangastream] adjust regex
9 years ago
Mike Fährmann
1416e7f6f7
[hentai2read] fix parsing for new page layout
9 years ago
Mike Fährmann
c9b7db5af5
[pixiv] code cleanup
9 years ago
Mike Fährmann
10fcc010bb
[nijie] cache login sessions
9 years ago
Mike Fährmann
c8e83f6560
[pixiv] cache login sessions
9 years ago
Mike Fährmann
81096f7790
[tumblr] fix json parsing
9 years ago
Mike Fährmann
f974ea73db
[tumblr] add tag-extractor
9 years ago
Mike Fährmann
58a0029bb2
[tumblr] add post-extractor
9 years ago
Mike Fährmann
8eb7232169
[tumblr] add extractor
9 years ago
Mike Fährmann
595e5872d3
[hentai2read] add multi-chapter extractor
9 years ago
Mike Fährmann
f3dc8851c8
[hentai2read] add a couple more keywords
9 years ago
Mike Fährmann
20228a003f
[hentai2read] add extractor
9 years ago
Mike Fährmann
23a572a20d
[pixiv] update testdata
9 years ago
Mike Fährmann
7f9aeb774e
[powermanga] fix image-urls
9 years ago
Mike Fährmann
5a98be1c45
[nhentai] remove 'favorites' keyword
9 years ago
Mike Fährmann
616e0aedd6
update booru testdata
9 years ago
Mike Fährmann
5a8541afa5
remove 'unstable' tests
9 years ago
Mike Fährmann
ba99506c72
more extractor test-cases
9 years ago
Mike Fährmann
a99fdb0d1e
[mangapark] fix regexes
9 years ago
Mike Fährmann
2449532132
add more extractor test-cases
9 years ago
Mike Fährmann
f0e9e8e0dc
ensure extractors() returns each extractor only once
9 years ago
Mike Fährmann
9c9b1e112a
[imgur] fix 'date' and 'count' keywords
9 years ago
Mike Fährmann
5589bc2ed7
[deviantart] fix non-terminating loop
9 years ago
Mike Fährmann
c8fdfbec42
[danbooru] add test cases
9 years ago
Mike Fährmann
5304e5beef
testing environment for extractor results
9 years ago
Mike Fährmann
75ff08f73c
[nijie] proper login and other issues fixed
9 years ago
Mike Fährmann
50ec170b00
[mangapark] add manga extractor
9 years ago
Mike Fährmann
0ff437ca88
[mangapark] add chapter extractor
9 years ago
Mike Fährmann
995d8578bf
[deviantart] fix dates in image-extractor
9 years ago
Mike Fährmann
7d965a2897
[deviantart] add single image extractor
9 years ago
Mike Fährmann
e4a661fd6b
[deviantart] fix issue with small images
9 years ago