Mike Fährmann
a610b35a0d
[mangashare] remove module
...
this site has been unavailable for at least two months
7 years ago
Mike Fährmann
4e8587bad4
[pixiv] add support for https://i.pximg.net URLs
7 years ago
Mike Fährmann
e41efbd2d9
[kissmanga] fix edge-case
8 years ago
Mike Fährmann
ffd72424bf
[kissmanga] another attempt at getting the AES key
8 years ago
Mike Fährmann
af56887a47
[exhentai] fall back to e-hentai if no username is given
8 years ago
Mike Fährmann
4b967fa189
implement and use extractor.config() method
8 years ago
Mike Fährmann
82ab1fca07
[seiga] reduce cache maxage to one week
8 years ago
Mike Fährmann
ec48d25afc
[pawoo] fix extraction results
8 years ago
Mike Fährmann
244ab75cad
[kissmanga] update AES key retrieval
8 years ago
Chen John L
a5485a46cb
fixed the module for pixhost
8 years ago
Mike Fährmann
13dc5d72bc
update some extractors to use https
8 years ago
Mike Fährmann
342371086b
[pawoo] add extractors for accounts and statuses
...
https://pawoo.net is a Mastodon[1] instance hosted by Pixiv
[1] https://github.com/tootsuite/mastodon
8 years ago
Mike Fährmann
0770de0ea1
[deviantart:image] add support for sta.sh URLs
8 years ago
Mike Fährmann
f4aa452bd1
update unit test results
8 years ago
Mike Fährmann
71e08dc9c4
[tumblr] keyword consistency
8 years ago
Mike Fährmann
c9a5650cf8
add manga extractors to all foolslide-based modules
8 years ago
Mike Fährmann
bd95fea82c
update unit test results
8 years ago
Mike Fährmann
0456efaa5a
[hentaifoundry] update unit tests
8 years ago
Mike Fährmann
fd3f84d913
[kissmanga] get AES key from site itself
8 years ago
Mike Fährmann
fece09d326
[fallenangels] update to new domain and site-layout
8 years ago
Mike Fährmann
cf79a47b59
update unit tests
8 years ago
Mike Fährmann
e23e4b1100
[seaotterscans] add extractor
8 years ago
Mike Fährmann
616464f8f8
[kireicake] add extractor
8 years ago
Mike Fährmann
f537ad5f2f
[kissmanga] re-enable module
8 years ago
Mike Fährmann
b603b592cf
[exhentai] accept "e-hentai.org" URLs ( #11 )
8 years ago
Mike Fährmann
11ce871718
[deviantart] add favourites-extractor
8 years ago
Mike Fährmann
d430732502
[deviantart] update extractors
...
- use base class for all extractors
- use API for single images
- add support for more API endpoints
- add additional keywords
8 years ago
Mike Fährmann
298d7c45f7
[nijie] support multi-page image listings
8 years ago
Mike Fährmann
91ad8ac2b3
[mangastream] adapt to domain-change to readms.net
8 years ago
Mike Fährmann
841fd50242
move code into util.py
8 years ago
Mike Fährmann
6cbb078392
[batoto] fix cache time for login sessions
...
from 1 year to 1 week ...
8 years ago
Mike Fährmann
6fd9e66223
[whentai] remove module
...
apparently they changed their system and now you can't download the
original images without an account with VIP status.
8 years ago
Mike Fährmann
dce5bce74e
[kissmanga] temporarily disable module
...
... until I've figured out how to decode their image urls
8 years ago
Mike Fährmann
4e7661ab01
[imgtrex] re-add extractor
8 years ago
Mike Fährmann
0257d3e7ac
[mangamint] remove extractors - site is down
8 years ago
Mike Fährmann
1d46be545c
add login notifications
8 years ago
Mike Fährmann
ed94d9b92d
fix/improve various things
8 years ago
Mike Fährmann
619c74159a
[seiga] fix file extension and xml parsing
...
- The file extension of the first image had been used for all further
images
- API responses can contain invalid characters, which cause the XML
parser to fail (http://seiga.nicovideo.jp/user/illust/26377934
contains several \x08 characters)
8 years ago
Mike Fährmann
66eb3d3488
fix tests
8 years ago
Mike Fährmann
f622411be5
[deviantart] implement 'skip' method
8 years ago
Mike Fährmann
dfe2c2dced
[batoto] update test results
8 years ago
Mike Fährmann
43e3bb24ae
[imagefap] don't rely on image-count
...
(fixes #9 )
8 years ago
Mike Fährmann
379125746a
[deviantart] improve API error handling
...
(#7 )
8 years ago
Mike Fährmann
f782282f97
add logger objects to extractors
8 years ago
Mike Fährmann
2c2de778f2
[deviantart] adjust error message
8 years ago
Mike Fährmann
c24aeb5cbc
[whentai] update test results
8 years ago
Mike Fährmann
f36d685ce1
[deviantart] always request access token before api calls
...
(#7 )
8 years ago
Mike Fährmann
ff92674379
[booru] simple skip functionality
...
(#6 )
8 years ago
Mike Fährmann
7a9d66fbce
implement basic way to tell extractors to skip ahead
8 years ago
Mike Fährmann
872b8aed97
[4chan] update test
8 years ago
Mike Fährmann
f361cb13e0
[hentai2read] fix extraction
8 years ago
Mike Fährmann
38aa496ecb
[deviantart] restore tests + set api version
8 years ago
Mike Fährmann
39b1a18f12
[deviantart] fix issue with missing 'content'-key
8 years ago
Mike Fährmann
e87e6fbc67
change some config keys
...
directory_fmt -> directory
filename_fmt -> filename
download-original -> original
8 years ago
Mike Fährmann
96baea0959
[hentaibox] remove extractor
8 years ago
Mike Fährmann
9d36acbbc4
[yonkouprod] update test results
8 years ago
Mike Fährmann
9a08f8a097
improved foolslide-based extractors
...
- this includes dokireader, fallenangels, jaiminisbox, powermanga,
sensescans, worldthree, yonkouprod, gomanga, yomanga
- added 'chapter_string', 'chapter_id', 'chapter_minor' and 'count'
keywords
- changed the 'chapter' keyword to always be just a number
- changed the default directory format
8 years ago
Mike Fährmann
0a6487afe8
[exhentai] fix detection of invalid gallery keys
8 years ago
Mike Fährmann
0b59d9f8c7
disable urllib3s InsecureConnectionWarning
8 years ago
Mike Fährmann
bad623751f
[hentaihere] transition to https
8 years ago
Mike Fährmann
331b413c60
update extractor test script
8 years ago
Mike Fährmann
c84e975dcb
[twitter] fix image extraction
8 years ago
Mike Fährmann
0af02007a9
[imagetwist] fix site access
8 years ago
Mike Fährmann
2f6e3874a7
[sensescans support http://sensescans.com/reader/ ... URLs
8 years ago
Mike Fährmann
52104b2bb6
[fallenangels] add chapter extractor
8 years ago
Mike Fährmann
7880cc1ad7
[imgtrex] remove extractor - domain no longer exists
8 years ago
Mike Fährmann
21e0dfbe20
[chronos] raise NotFoundError instead of crashing
8 years ago
Mike Fährmann
2b38398940
[imgyt] raise NotFoundError instead of crashing
8 years ago
Mike Fährmann
94e10f249a
code adjustments according to pep8 nr2
8 years ago
Mike Fährmann
f1b7d41608
[mangamint] fix keyword extraction
8 years ago
Mike Fährmann
8e93633319
[nhentai] fix image urls
8 years ago
Mike Fährmann
d82508f245
fix tests for turboimagehost and pinterest
8 years ago
Mike Fährmann
3434c5a026
[pinterest] add support for pin.it URLs
8 years ago
Mike Fährmann
37d4d07d9b
compatibility fixes to make a standalone exe work
8 years ago
Mike Fährmann
4553a6392f
[whentai] add unittests
8 years ago
Mike Fährmann
434ef4d5a2
[mangafox] raise proper exception if chapter is not available
8 years ago
Mike Fährmann
98fa5cf2fa
[mangafox] add chapter extractor
8 years ago
Mike Fährmann
cc0b4f2661
[yomanga] add chapter extractor
8 years ago
Mike Fährmann
ad4b02508f
trying to understand travis-ci unit test failures
...
- added some debug output via logging module
- unit tests work on my machine (tm)
8 years ago
Mike Fährmann
72d3ca0bf9
[deviantart] use API for user-extractor
8 years ago
Mike Fährmann
00074a71d7
several changes to make travis build work
...
- fixed html.unescape not being available on Python3.3
- removed inconsistent test result
- added username/password pairs for authenticating extractors
8 years ago
Mike Fährmann
cfe5bf732a
[gomanga] add chapter extractor
8 years ago
Mike Fährmann
4a8d74973c
adjust login methods to a specific style
8 years ago
Mike Fährmann
98d6d131a3
update unittests for batoto and yonkouprod
8 years ago
Mike Fährmann
468c9aeeec
make tests more reliable
8 years ago
Mike Fährmann
33c799b2ae
[yonkouprod] rename 'yonkou' to 'yonkouprod'
8 years ago
Mike Fährmann
95986ed566
[seiga] add user extractor
8 years ago
Mike Fährmann
efaba5f398
[luscious] support new album URLs + small fixes
8 years ago
Mike Fährmann
79ea457e24
[luscious] use new 'html' attribute in API responses
8 years ago
Mike Fährmann
a8d716c043
[pinterest] tests + fix error message
8 years ago
Mike Fährmann
a849d8f2f7
add a few more tests
8 years ago
Mike Fährmann
7952b8d18d
add a few tests expecting exceptions
8 years ago
Mike Fährmann
efdc299547
[hentaifoundry] get artist name from webpage
8 years ago
Mike Fährmann
1aeb60d997
[jaiminisbox] add extractor
8 years ago
Mike Fährmann
8b2024a1a5
[hentaifoundry] support direct links to images
8 years ago
Mike Fährmann
c604a65b88
[imgyt] use token as filename if none is given
8 years ago
Mike Fährmann
3a7421a6ce
[twitter] get 'original' instead of 'large' image
8 years ago
Mike Fährmann
cb180507ab
[batoto] add manga extractor
8 years ago
Mike Fährmann
ff2a65d5c1
[exhentai] raise proper exception for 'unavailable' galleries
8 years ago
Mike Fährmann
f69209871d
[kisscomic] change some names from 'manga' to 'comic'
8 years ago
Mike Fährmann
d623b9bfdc
[readcomics] code cleanup + tests
8 years ago
Mike Fährmann
c19241e299
[readcomics] add comic extractor
8 years ago
Mike Fährmann
179d62023c
[readcomics] add comic-issue extractor
8 years ago
Mike Fährmann
d12a04af3c
[test] filter out classes without a 'test' attribute
8 years ago
Mike Fährmann
40dbea7ed2
rewrite parts of the cloudflare bypass system
8 years ago
Mike Fährmann
3c4155c9c9
[kisscomic] add extractors
8 years ago
Mike Fährmann
06c798d18e
[yonkou] add chapter extracter
8 years ago
Mike Fährmann
effdf9c3be
[luscious] adapt to API changes
8 years ago
Mike Fährmann
4c55275305
update tests
8 years ago
Mike Fährmann
69cde97c93
add utility extractor that runs test-URLs
8 years ago
Mike Fährmann
b0e8daf415
[imgclick] remove extractor - uses captcha
8 years ago
Mike Fährmann
0211ec4114
update some tests
8 years ago
Mike Fährmann
dfd1992a2c
[hentaifoundry] small updates
...
- throw an exception if an user or image does not exist
- update tests, since the user of the old ones left
8 years ago
Mike Fährmann
2fae0b1803
[fapat] add extractor
8 years ago
Mike Fährmann
583f1b8bbb
[postimg] add extractor
8 years ago
Mike Fährmann
d1cd9acf54
[pixhost] adjust to new site layout
8 years ago
Mike Fährmann
0989cd2430
add basic support for file:// URLs
...
this allows you to feed local files into the recursive extractor
8 years ago
Mike Fährmann
91dff9827f
[luscious] always provide URLs to the original images
8 years ago
Mike Fährmann
d402e644bf
update tests
8 years ago
Mike Fährmann
46440fda2d
[imagevenue] add extractor
8 years ago
Mike Fährmann
2449825d53
[kissmanga] solve cloudflare challenge on demand
8 years ago
Mike Fährmann
9e3788175e
implement decorator for cloudflare bypass
...
this method for enabling and caching a cloudflare bypass for a
requests.session object allows for different cache-timeouts for
different domains
8 years ago
Mike Fährmann
6e98538d36
[mangamint] small fixes and additions
...
- force https
- update patterns to also catch non-standard URLs to manga and chapters
- handle URLs to non-existing resources gracefully
- fix terminating condition for chapter listings
- add a base class for common code
- add and update tests
8 years ago
Mike Fährmann
c333bc33e3
[mangapark] small fixes and additions
...
- add a 'title' keyword for chapter-titles and update the directory
format accordingly
- add a 'type' keyword to distinguish between manga and manhwa
- fix an issue where an exception would be thrown if a chapter number
did not have any special additions (2.5, 55a, v2, etc.)
- add a test-case without a special chapter number
- unescape manga title
8 years ago
Mike Fährmann
b634ace39e
[readcomiconline] add comic-issue and comic extractor
8 years ago
Mike Fährmann
99440ca51a
[imgtrial] add extractor
8 years ago
Mike Fährmann
5f2824dfe6
[imgspot] add extractor
8 years ago
Mike Fährmann
c85adbdc9d
[mangamint] code simplifications
8 years ago
Mike Fährmann
88193718e8
[pixhost] add extractor
8 years ago
Mike Fährmann
07e9e2c4f1
[imgmaid] add extractor
8 years ago
Mike Fährmann
885aa7f7cf
[img4ever] add extractor
8 years ago
Mike Fährmann
5c69a380f0
[kissmanga] code simplifications
8 years ago
Mike Fährmann
4f51d72d22
[imgbox] handle non-existing images/galleries
8 years ago
Mike Fährmann
68fe58ee72
[imgchili] set encoding
8 years ago
Mike Fährmann
58ce0b55e3
[deviantart] make sure to pick the highest quality image
8 years ago
Mike Fährmann
37ea66098a
add tests
8 years ago
Mike Fährmann
653885abf2
[doujinmode] remove extractor - site is down
8 years ago
Mike Fährmann
78b168820d
move another 4 extractors
8 years ago
Mike Fährmann
5e82e8dfbd
move chronos & co. to imagehosts file
8 years ago
Mike Fährmann
8b7f719f36
combine imagehost extractors into a single file
...
added extractors for
- hosturimage.com
- imageontime.org
- imgupload.yt
- imgspice.com
- imgclick.net
All of these would have shared a lot of common code, so i created a base
class for imagehost extractors and put them all in the same file to
avoid clutter.
8 years ago
Mike Fährmann
e6d26f0476
don't overwrite a response's encoding with None
8 years ago
Mike Fährmann
e0b3339107
[imgur] match mobile urls (m.imgur.com)
8 years ago
Mike Fährmann
04b1519779
[hitomi] fix domain of image-urls
8 years ago
Mike Fährmann
2004f6bd67
add a few tests
8 years ago
Mike Fährmann
005c539829
improve foolslide volume- and chapter-keywords
8 years ago
Mike Fährmann
2a632c9bfd
[worldthree] add chapter extractor
8 years ago
Mike Fährmann
828aedd571
[khinsider] unescape soundtrack title
8 years ago
Mike Fährmann
3078e4c9f5
[sensescans] add chapter extractor
8 years ago
Mike Fährmann
5374f12bd0
[dokireader] use foolslide base class
8 years ago
Mike Fährmann
f4c2461ba7
[powermanga] use foolslide base class
8 years ago
Mike Fährmann
e1ce27f41b
add base class for foolslide based sites
8 years ago
Mike Fährmann
46a3f666df
[whentai] add single image extractor
8 years ago
Mike Fährmann
a0f56b2c54
update tests
8 years ago
Mike Fährmann
f415d4816b
[whentai] add user extractor
8 years ago
Mike Fährmann
d793e16463
[nhentai] fix subcategory value
8 years ago
Mike Fährmann
02a441503a
[pinterest] adjust regex pattern
8 years ago
Mike Fährmann
a33b13c631
[8chan] fix file urls
8 years ago
Mike Fährmann
ffc3c2d32c
[imgbox] transition to https
8 years ago
Mike Fährmann
492cb38391
[exhentai] use image-count as stop signal
8 years ago
Mike Fährmann
607f50effb
[exhentai] retry failed api calls
8 years ago
Mike Fährmann
f7c993d952
set 'extension' keyword whenever possible
8 years ago
Mike Fährmann
be73af551e
[rapidimg] unset test from parent class
8 years ago
Mike Fährmann
8c8ad08e28
[imgur] fix image url retrieval
8 years ago
Mike Fährmann
bf8d88499a
[twitter] add extractor
8 years ago
Mike Fährmann
e3926bf351
[hentaihere] add manga- and chapter-extractors
8 years ago
Mike Fährmann
c155c7b94b
[hentai2read] put some common code in a base class
8 years ago
Mike Fährmann
277c505b8d
[picmaniac] add extractor
8 years ago
Mike Fährmann
a0c044f0c9
[rapidimg] add extractor
8 years ago
Mike Fährmann
883e702fd6
[mangapark] remove 'url' keyword + fix tests
8 years ago
Mike Fährmann
c20a3b3a01
[*chan] code cleanup
8 years ago
Mike Fährmann
d31ccb16f2
rename 'generic' to 'recursive'
8 years ago
Mike Fährmann
12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
8 years ago
Mike Fährmann
8d106a447c
[tumblr] delete more useless keywords
8 years ago
Mike Fährmann
051c181138
[dokireader] add chapter extractor
8 years ago
Mike Fährmann
1134339c1f
Merge branch 'category'
8 years ago
Mike Fährmann
56d810c896
update keyword hashes for tests
8 years ago
Mike Fährmann
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
Mike Fährmann
0a3fb198f3
[batoto] raise exception if chapter is unavailable ( #4 )
8 years ago
Mike Fährmann
3f985d5342
[hitomi] fix some keywords
8 years ago
Mike Fährmann
9d107b8e1b
[dynastyscans] add chapter extractor
8 years ago
Mike Fährmann
975a7cb6b9
[batoto] add (optional) login capabilities
8 years ago
Mike Fährmann
e3d156078c
[exhentai] rewrite
8 years ago
Mike Fährmann
49a05c32ed
add missing tests
8 years ago
Mike Fährmann
a017cd9e63
[exhentai] metadata consistency
8 years ago
Mike Fährmann
fea3be0aed
[nijie] add image-extractor
8 years ago
Mike Fährmann
d324c58038
[rule34] add tag- and image-extractor
8 years ago
Mike Fährmann
85ff3d160e
[tumblr] fix json parsing + metadata consistency
8 years ago
Mike Fährmann
80d98f97fa
[hbrowse] add manga extractor
8 years ago
Mike Fährmann
4cb886be78
[turboimagehost] add tests
8 years ago
Mike Fährmann
26a9b7beee
[imagetwist] small fixes + tests
8 years ago
Mike Fährmann
a9be82ecc2
[imgbox] small fixes + tests
8 years ago
Mike Fährmann
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
Mike Fährmann
888a988725
[imgchili] workaround for long filenames
8 years ago
Mike Fährmann
155af213a9
[imgtrex] add extractor
8 years ago
Mike Fährmann
dbdd43cff5
[imgcandy] add extractor
8 years ago
Mike Fährmann
44a5052302
[coreimg] add extractor
8 years ago
Mike Fährmann
dcd213f13e
[nijie] raise NotFoundError
8 years ago
Mike Fährmann
8f6d055deb
[pinterest] raise NotFoundError + tests
8 years ago
Mike Fährmann
517e88680f
[pinterest] add board extractor
8 years ago
Mike Fährmann
79721a65ff
[pinterest] add pin extractor
8 years ago
Mike Fährmann
2afa65cfc7
[imagebam] add single-image extractor
8 years ago
Mike Fährmann
808cf69556
update a few tests
8 years ago
Mike Fährmann
49359d375c
[exhentai] unescape title
8 years ago
Mike Fährmann
95097fac00
[exhentai] transition to https
8 years ago
Mike Fährmann
98877a45fb
[seiga] raise NotFoundError
8 years ago
Mike Fährmann
30d10cf595
[pixiv] fix KeyError if no status is present
8 years ago
Mike Fährmann
effa1084f2
[pixiv] raise NotFoundError instead of failing
8 years ago
Mike Fährmann
813320d7db
[seiga] match direct-links to images
8 years ago
Mike Fährmann
85cd7c34b1
[pixiv] match direct-links to images
8 years ago
Mike Fährmann
6d401b1118
precompile regular expressions
8 years ago
Mike Fährmann
fa14ef17ea
[imagefap] deal with long filenames
8 years ago
Mike Fährmann
5a5b47e77a
[imagefap] add user extractor
8 years ago
Mike Fährmann
d9c5b7a102
[imagefap] add single-image extractor
8 years ago
Mike Fährmann
6792c68254
[seiga] add extractor
8 years ago
Mike Fährmann
dac796879a
[imagefap] add extractor
8 years ago
Mike Fährmann
3e8f70188f
[hentaibox] add extractor
8 years ago
Mike Fährmann
5a13ac8e3d
[doujinmode] small fixes + test
8 years ago
Mike Fährmann
25f56c9061
[doujinmode] add extractor
8 years ago
Mike Fährmann
a2c5b1e07d
[imgchili] rewrite + single-image extractor
8 years ago
Mike Fährmann
43210391ea
[imgyt] add extractor
8 years ago
Mike Fährmann
b9be7f5907
[chronos] fix + test
8 years ago
Mike Fährmann
b6a68775d4
[senmanga] add chapter extractor
8 years ago
Mike Fährmann
2faa7393b1
[mangahere] adjust for image domain
8 years ago
Mike Fährmann
c2c2e85da3
[imgur] unescape album title + other fixes
8 years ago
Mike Fährmann
db1738d451
[luscious] add extractor
8 years ago
Mike Fährmann
d01b21c6c8
[nijie] change 'email'-parameter to 'username'
8 years ago
Mike Fährmann
f0f7306db6
re-raise async exceptions in main thread
8 years ago
Mike Fährmann
0e20be5a0a
[exhentai] provide username/password auth
8 years ago
Mike Fährmann
0ba9601b63
[nijie] raise AuthError
8 years ago
Mike Fährmann
3136278f79
[pixiv] add option to skip ugoiras
8 years ago
Mike Fährmann
59445c821b
[gelbooru] remove login/auth requirement
8 years ago
Mike Fährmann
221b3869cf
[mangastream] adapt to new page structure
8 years ago
Mike Fährmann
d6c06f9efd
add authentication-exception
8 years ago
Mike Fährmann
6f7d42b974
update tests
8 years ago
Mike Fährmann
93c8f6e777
[nhentai] fix json detection
8 years ago
Mike Fährmann
000df8d1fa
add 'encoding' argument for Extractor.request
8 years ago
Mike Fährmann
b5e62ec308
[mangastream] adjust regex agein ( fixes #2 )
9 years ago
Mike Fährmann
2b15b81673
[khinsider] add extractor
9 years ago
Mike Fährmann
0736fe29e2
[mangahere] fix parsing
9 years ago
Mike Fährmann
7af8ae509c
[mangastream] adjust regex
9 years ago
Mike Fährmann
1416e7f6f7
[hentai2read] fix parsing for new page layout
9 years ago
Mike Fährmann
c9b7db5af5
[pixiv] code cleanup
9 years ago
Mike Fährmann
10fcc010bb
[nijie] cache login sessions
9 years ago
Mike Fährmann
c8e83f6560
[pixiv] cache login sessions
9 years ago
Mike Fährmann
81096f7790
[tumblr] fix json parsing
9 years ago
Mike Fährmann
f974ea73db
[tumblr] add tag-extractor
9 years ago
Mike Fährmann
58a0029bb2
[tumblr] add post-extractor
9 years ago
Mike Fährmann
8eb7232169
[tumblr] add extractor
9 years ago
Mike Fährmann
595e5872d3
[hentai2read] add multi-chapter extractor
9 years ago
Mike Fährmann
f3dc8851c8
[hentai2read] add a couple more keywords
9 years ago
Mike Fährmann
20228a003f
[hentai2read] add extractor
9 years ago
Mike Fährmann
23a572a20d
[pixiv] update testdata
9 years ago
Mike Fährmann
7f9aeb774e
[powermanga] fix image-urls
9 years ago
Mike Fährmann
5a98be1c45
[nhentai] remove 'favorites' keyword
9 years ago
Mike Fährmann
616e0aedd6
update booru testdata
9 years ago
Mike Fährmann
5a8541afa5
remove 'unstable' tests
9 years ago
Mike Fährmann
ba99506c72
more extractor test-cases
9 years ago
Mike Fährmann
a99fdb0d1e
[mangapark] fix regexes
9 years ago
Mike Fährmann
2449532132
add more extractor test-cases
9 years ago
Mike Fährmann
f0e9e8e0dc
ensure extractors() returns each extractor only once
9 years ago
Mike Fährmann
9c9b1e112a
[imgur] fix 'date' and 'count' keywords
9 years ago
Mike Fährmann
5589bc2ed7
[deviantart] fix non-terminating loop
9 years ago
Mike Fährmann
c8fdfbec42
[danbooru] add test cases
9 years ago
Mike Fährmann
5304e5beef
testing environment for extractor results
9 years ago
Mike Fährmann
75ff08f73c
[nijie] proper login and other issues fixed
9 years ago
Mike Fährmann
50ec170b00
[mangapark] add manga extractor
9 years ago
Mike Fährmann
0ff437ca88
[mangapark] add chapter extractor
9 years ago
Mike Fährmann
995d8578bf
[deviantart] fix dates in image-extractor
9 years ago
Mike Fährmann
7d965a2897
[deviantart] add single image extractor
9 years ago
Mike Fährmann
e4a661fd6b
[deviantart] fix issue with small images
9 years ago
Mike Fährmann
3ebd126b35
[imgbox] add single image extractor
9 years ago
Mike Fährmann
a71805bacf
[chronos] add extractor
9 years ago
Mike Fährmann
cb53b29391
[imagetwist] adjust pattern and other fixes
9 years ago
Mike Fährmann
65c8566326
add provisional generic extractor
9 years ago
Mike Fährmann
e7512f626d
[turboimagehost] add extractor
9 years ago
Mike Fährmann
56876b76f1
[imagetwist] add extractor
9 years ago
Mike Fährmann
bd87b5186d
[spectrumnexus] recognize volumes
9 years ago
Mike Fährmann
2ced575c4a
[spectrumnexus] add manga-extractor
9 years ago
Mike Fährmann
f7c47a6018
add subcategories to extractors
9 years ago
Mike Fährmann
81dcfbec90
initial support for extractor-subcategories
9 years ago
Mike Fährmann
1497da07de
remove unused format-strings
9 years ago
Mike Fährmann
c23eaccf46
[hentaifoundry] add single image extractor
9 years ago
Mike Fährmann
34210edf9a
[mangashare] add manga-extractor
9 years ago
Mike Fährmann
f48712c9c9
docstrings
9 years ago
Mike Fährmann
9cb184d409
[powermanga] support another url-pattern
9 years ago
Mike Fährmann
1eaf0a55a6
[mangamint] add manga-extractor
9 years ago
Mike Fährmann
914062d172
use text.extract_iter where applicable
9 years ago
Mike Fährmann
332d9e393b
[mangahere] support sub-chapters (e.g. ch4.5)
9 years ago
Mike Fährmann
88739a3564
[mangahere] add manga-extractor
9 years ago
Mike Fährmann
2b93fdba7c
[kissmanga] unify extractor metadata in base class
9 years ago
Mike Fährmann
763792f207
[kissmanga] add manga-extractor
9 years ago
Mike Fährmann
a1c09ff04d
[mangapanda] fix regex
9 years ago
Mike Fährmann
a7243b5ac5
bugfix: add patterns to cache before returning them
9 years ago
Mike Fährmann
d8f692f711
[mangapanda] add manga-extractor
9 years ago
Mike Fährmann
63d693866c
[mangareader] remove leading spaces from manga names
9 years ago
Mike Fährmann
20efe49f83
[mangareader] unify extractor metadata in base class
9 years ago
Mike Fährmann
d5349c8cb5
[mangareader] add manga-extractor (all chapters)
9 years ago
Mike Fährmann
3a93faa372
add and implement Queue message
9 years ago
Mike Fährmann
d1673d912a
[mangahere] add chapter-extractor
9 years ago
Mike Fährmann
8b6f02a615
[mangamint] add chapter extractor
9 years ago
Mike Fährmann
3fb5a8b834
delay 'requests'-import
9 years ago
Mike Fährmann
a4c880f4c5
[pixiv] add bookmark extractor
9 years ago
Mike Fährmann
daf5fcd416
[pixiv] add user-favorite extractor
9 years ago
Mike Fährmann
20a4782173
[pixiv] get rid of an unnecessry api-call
9 years ago
Mike Fährmann
2a97296e69
[pixiv] add single work/illust extractor
9 years ago
Mike Fährmann
9251ea5771
[powermanga] update to new format
9 years ago
Mike Fährmann
68e7f7427d
Merge branch 'multi-extractor'
9 years ago
Mike Fährmann
4d56b76aa8
update all other extractors
9 years ago
Mike Fährmann
ad12180027
[redhawkscans] remove module
9 years ago
Mike Fährmann
bcb23e44ce
[powermanga] transfer code from redhawkscans
9 years ago
Mike Fährmann
2dfe97dd00
[chan] update to new format
9 years ago
Mike Fährmann
2d498b19a1
remove 'info' parameter
9 years ago
Mike Fährmann
78234f0572
[safebooru] update to new format
9 years ago
Mike Fährmann
bb8f2a3e9d
[gelbooru] update to new format
9 years ago
Mike Fährmann
63a38edd05
[konachan] update to new format
9 years ago
Mike Fährmann
23208a49b8
[e621] update to new format
9 years ago
Mike Fährmann
1bce63124b
[3dbooru] update to new format
9 years ago
Mike Fährmann
70a6599904
[yandere] update to new format
9 years ago
Mike Fährmann
15dec86e6a
[danbooru] update to new format
9 years ago
Mike Fährmann
74199422a8
[booru] add base classes for tag/pool/post extractors
9 years ago
Mike Fährmann
900577b013
restructure info-parameters
9 years ago
Mike Fährmann
205ef3ca02
[danbooru] add single image/post extractor
9 years ago
Mike Fährmann
ee1ba22d05
[danbooru] add pool extractor
9 years ago
Mike Fährmann
80917f5392
[danbooru] rewrite to use multiple extractors
9 years ago
Mike Fährmann
8c3783706d
allow multiple extractors per module
9 years ago
Mike Fährmann
e9547ebdf3
[exhentai] configurable wait-times
9 years ago
Mike Fährmann
9c63027d2c
[exhentai] fix 'imgkey' handling
9 years ago
Mike Fährmann
4440b40234
[exhentai] better language keywords
9 years ago
Mike Fährmann
1c9296140c
[hitomi] provide proper language keywords
9 years ago
Mike Fährmann
7547d8be3f
[spectrumnexus] add additional regex
9 years ago
Mike Fährmann
c2f0720184
code cleanup to use nameext_from_url
9 years ago
Mike Fährmann
41f5971e73
[mangashare] add extractor
9 years ago
Mike Fährmann
3f2fbd874d
[hbrowse] add extractor
9 years ago
Mike Fährmann
783e62b621
[hentaifoundry] code cleanup
9 years ago
Mike Fährmann
eb4a87b620
[hentaifoundry] add extractor
9 years ago
Mike Fährmann
dd796e91c0
[spectrumnexus] add extractor
9 years ago
Mike Fährmann
73eeed3e72
[imgur] rewrite
9 years ago
Mike Fährmann
4427734b70
[imgur] fix parsing
9 years ago
Mike Fährmann
129ca282e4
[chan] unescape title
9 years ago
Mike Fährmann
3510faaed5
[sankaku] always use correct file-url
9 years ago
Mike Fährmann
3560935318
[exhentai] fix module dicstring
9 years ago
Mike Fährmann
60833abcc6
[sankaku] re-enable extractor
9 years ago
Mike Fährmann
36b376b5ba
[mangastream] add extractor
9 years ago
Mike Fährmann
009761fcd5
[mangapanda] add extractor
9 years ago
Mike Fährmann
5abe32a32c
[kissmanga] fix internal regex
9 years ago
Mike Fährmann
1302f5a0f6
[kissmanga] add extractor
9 years ago
Mike Fährmann
3b0fe8f544
unify booru filename-patterns
9 years ago
Mike Fährmann
c05dbd15b5
[gelbooru] support authentication to enable api access
9 years ago
Mike Fährmann
8469b3ae4f
[safebooru] add extractor
9 years ago
Mike Fährmann
6772b54bc4
[konachan] add extractor
9 years ago
Mike Fährmann
8e9bd1d793
sensible output if no extractor found
9 years ago
Mike Fährmann
6ed26864ea
[batoto] rewrite and fix
9 years ago
Mike Fährmann
686a4ddd3e
[8chan] fix file-urls
9 years ago
Mike Fährmann
c0efea339e
[imagebam] rewrite/fix
9 years ago
Mike Fährmann
e3e754eed7
[imgbox] use text.extract_all
9 years ago
Mike Fährmann
1352187758
[imgth] use text.extract_all
9 years ago
Mike Fährmann
353ac1e00b
[exhentai] use text.extract_all
9 years ago
Mike Fährmann
1fa6a99f18
[mangareader] rewrite
9 years ago
Mike Fährmann
cc5e37aeae
[powermanga] adjust regex
9 years ago
Mike Fährmann
ec6c1fd18e
[redhawkscans] use langcode to -name mapping
9 years ago
Mike Fährmann
6dcfed16fc
[powermanga] just inherit from redhawkscans
9 years ago
Mike Fährmann
d6325865e8
[redhawkscans] generalize to allow subclassing
9 years ago
Mike Fährmann
b47f3b9d78
[exhentai] reenable extractor
9 years ago
Mike Fährmann
2472d0722a
[hitomi] more metadata
9 years ago
Mike Fährmann
9cfe2c78a5
add extractor 'imgth'
9 years ago
Mike Fährmann
25f48101e5
add extractor 'hitomi'
9 years ago
Mike Fährmann
6ce181bcfe
add extractor 'nhentai'
9 years ago
Mike Fährmann
cf8f4cd179
[imgur] add to list of extractors
9 years ago
Mike Fährmann
c47bb4d570
add extractor 'imgur'
9 years ago
Mike Fährmann
4cb419b5d9
[chan] unescape html entities in title
9 years ago
Mike Fährmann
c14b9895ad
add extractor 'powermanga'
9 years ago
Mike Fährmann
f5d5684119
[pixiv] reuse api-tokens
9 years ago
Mike Fährmann
c8e0efe1ff
[pixiv] refresh access-token every 50 minutes
9 years ago
Mike Fährmann
b8b48ef795
[deviantart] add to extractor list
9 years ago
Mike Fährmann
76f32addf9
[booru] skip images without 'file-url' attribute
9 years ago
Mike Fährmann
0e5ef06ac0
Merge branch 'loader'
9 years ago
Mike Fährmann
733ae601da
enable user-specified patterns
9 years ago
Mike Fährmann
49e91bcb73
adjust loader to new config-interface
9 years ago
Mike Fährmann
e23aaa4298
Merge branch 'config' into loader
9 years ago
Mike Fährmann
539faa0322
remove SequentialExtractor class
9 years ago
Mike Fährmann
7d7c1afe20
[deviantart] adjust constructor paramters
9 years ago
Mike Fährmann
88442ad26d
Merge branch 'config'
9 years ago
Mike Fährmann
3c13548f29
rewrite extractors to use config-module
9 years ago
Mike Fährmann
ae535ba0c1
add extractor 'deviantart'
9 years ago
Mike Fährmann
42b8e81a68
rewrite extractors to use text-module
9 years ago
Mike Fährmann
d7e0d81bdd
[8chan] use api
9 years ago
Mike Fährmann
d8ef128e74
[4chan] update default filename and directory
9 years ago
Mike Fährmann
1998ec9b13
[pixiv] update user-agent to newest version
9 years ago
Mike Fährmann
c9ef181b3c
[4chan] use api
9 years ago
Mike Fährmann
c8e5b2e89e
base class for futaba-chan boards with api
9 years ago
Mike Fährmann
26bb9d62de
move and rework extractor-loading code
9 years ago
Mike Fährmann
63992363a6
[pixiv] handle timestamps at the end of urls
9 years ago
Mike Fährmann
13ebca2a48
[mangareader] supply correct width and height
9 years ago
Mike Fährmann
2afe15b217
[redhawkscans] let requests handle content decoding
9 years ago
Mike Fährmann
675937c77c
[mangareader] add extractor
9 years ago
Mike Fährmann
58dfd1a38f
[redhawkscans] fix chapter parsing
9 years ago
Mike Fährmann
a9e68c2745
[redhawkscans] fix json extraction
9 years ago
Mike Fährmann
b3f656ffd5
[redhawkscans] add extractor
9 years ago
Mike Fährmann
d9d88f1448
[pixiv] fix ugoira parsing
9 years ago
Mike Fährmann
68c4306040
[pixiv] transition to pixiv public api
9 years ago
Mike Fährmann
c0530a635c
[batoto] a few fixes
...
- removed 'volume' fields from default format strings
- fixed parsing by making volumes optional
- removed debug output
- updated docstring
- added a few unescape calls
10 years ago
Mike Fährmann
a145a73d05
add extractor 'nijie'
10 years ago
Mike Fährmann
9c25c15438
[3dbooru] fix default regex
10 years ago
Mike Fährmann
5993177ae3
[4chan] more metadata entries (size, width, height)
10 years ago
Mike Fährmann
a2cfbe445f
add extractor '3dbooru'
10 years ago
Mike Fährmann
762ad7426a
add extractor 'yandere'
10 years ago
Mike Fährmann
07f23dc2fa
add extractor '4chan'
10 years ago
Mike Fährmann
fae1b28c48
[pixiv] fix parsing of illust_ids
10 years ago
Mike Fährmann
ffec41f352
[imgchili] update to new extractor interface
10 years ago
Mike Fährmann
f3e208c0ab
[batoto] update to new extractor interface
10 years ago
Mike Fährmann
3c6161eea7
small whitespace fixes
10 years ago
Mike Fährmann
593a29b677
[imgbox] update to new extractor interface
10 years ago
Mike Fährmann
e41768d969
[imagebam] update to new extractor interface
10 years ago
Mike Fährmann
758fe00441
[e621] update to new extractor interface
10 years ago
Mike Fährmann
5cb46a2cb3
[gelbooru] update to new extractor interface
10 years ago
Mike Fährmann
1f4866fcd6
[danbooru] update to new extractor interface
10 years ago
Mike Fährmann
8c7da93d19
move and update BooruExtractor classes
10 years ago
Mike Fährmann
8f24329e30
[pixiv] fix http headers and cookies
10 years ago
Mike Fährmann
5806e02f97
better support for KeyboardInterrupt exceptions
10 years ago
Mike Fährmann
1cd25b5369
[pixiv] update to new extractor interface
10 years ago
Mike Fährmann
30b9db43a0
[8chan] combine patterns
10 years ago
Mike Fährmann
cd4a699dd2
add 'Headers' and 'Cookies' message
10 years ago
Mike Fährmann
f31c05f522
[8chan] update to new extractor interface
10 years ago
Mike Fährmann
513808d156
move code from util.py
10 years ago
Mike Fährmann
41f00809ff
update extractor base classes
10 years ago
Mike Fährmann
7c12ba1c31
move DownloadManager and ExtractorFinder
10 years ago
Mike Fährmann
d13608e909
[pixiv] fix parsing of illust-ids
10 years ago
Mike Fährmann
a66a5099f8
added extractor 'imgchili'
10 years ago
Mike Fährmann
ac002cc4b3
[8chan] fix image urls
10 years ago
Mike Fährmann
54d40b85fb
[pixiv] load balancing for image servers
10 years ago
Mike Fährmann
0f6cc964cc
[8chan] use new domainname for thread-urls
10 years ago
Mike Fährmann
34d13bc906
added extractor 'danbooru' + split BooruExtractor to handle XML and JSON
10 years ago
Mike Fährmann
2a7dbd8868
[booru] unquote tags to fix multiple tags in urls
10 years ago
Mike Fährmann
099fe7515e
added extractor 'e621'
10 years ago
Mike Fährmann
1244c933a1
[8chan] fix image urls
10 years ago
Mike Fährmann
729d2d8b20
[imagebam] fixed issue with destination direcotry name
10 years ago
Mike Fährmann
98dd5f9a90
added extractor 'imagebam'
10 years ago
Mike Fährmann
ff53b7f6fa
added extractor 'imgbox'
10 years ago
Mike Fährmann
4950cb0ab9
use 'safe_request' to handle connection errors
10 years ago
Mike Fährmann
7588974306
fixed various bugs
...
- forgot "self." before "name_fmt"
- image keys where off by one
10 years ago
Mike Fährmann
deef91eddc
initial commit
10 years ago