Mike Fährmann
6a87c314af
[instagram] fix private posts with long shortcodes ( #4362 )
1 year ago
Mike Fährmann
f899fac4c5
[giantessbooru] fix extraction ( #4373 )
...
This does not fix anything Cloudflare related,
just other things caused by a site update.
1 year ago
Mike Fährmann
136283d402
[shimmie2] update base URL pattern
...
to match new giantessbooru URLs
1 year ago
Mike Fährmann
c79359eb3a
[fantia] improve metadata extraction ( #4126 )
...
extract all metadata and URLs before starting to download
1 year ago
Mike Fährmann
48ef062867
fix issues with 'Extractor.finalize()'
...
- prevent crash in InstagramUserExtractor (#4359 )
- call it at the end of every DownloadJob
- add it to tests
1 year ago
Mike Fährmann
ed21908fda
initial support for child extractor options
...
Using "parent-category>child-category" as extractor category in a config
file allows to set options for a child extractor when it was spawned by
that parent.
For example "reddit>gfycat" to set gfycat options for when it was found
in a reddit post.
{
"extractor": {
"gfycat": {
"filename": "regular filename"
},
"reddit>gfycat": {
"filename": "reddit-specific filename"
}
}
}
Note: This does currently not work for most imgur links due to how its
extractor hierarchy is structured.
1 year ago
Mike Fährmann
255d08b79e
add test for 'Extractor.initialize()' ( #4359 )
1 year ago
Mike Fährmann
2bcf0a4c49
[instagram] fix initialization order ( #4359 )
...
regression caused by the changes in a383eca7
1 year ago
Mike Fährmann
7eab101144
[acidimg] fix extraction
...
swap ' and " again (2e309a13
)
and add a fallback in case this happens yet another time
1 year ago
Mike Fährmann
62fce6a75f
[imagehosts] adjust variable names ( #4358 )
...
prefix them with underscores to prevent a clash
with the new 'self.cookies' from d97b8c2f
1 year ago
Mike Fährmann
e8299b459a
[moebooru] match search URLs with empty 'tags' ( #4354 )
1 year ago
Mike Fährmann
7fbc304ae9
[twitter] fix crash on private user ( #4349 )
1 year ago
Mike Fährmann
1ece3b92ff
[mangadex] allow multiple values for 'lang' ( #4093 )
...
This was already possible by setting 'lang' to a list of strings,
but now it can also be done as a more command-line friendly string.
-o lang=fr,it
1 year ago
Mike Fährmann
52053b58f0
[lensdump] fix extraction ( #4352 )
1 year ago
Mike Fährmann
11f71a9cba
remove 'mememuseum' module
...
This was forgotten when adding generic Shimmie2 support in 7865067d
1 year ago
Mike Fährmann
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
Mike Fährmann
1baf83a9e5
[hiperdex] fix for unicode titles ( #4325 )
1 year ago
Mike Fährmann
7da954f810
[flickr] update default API credentials ( #4332 )
...
and add a delay between API requests
1 year ago
Mike Fährmann
a45a17ddb7
[pixiv] ignore 'limit_sanity_level' images ( #4328 )
1 year ago
Mike Fährmann
088e8d5fcf
[pornhub] fix extraction ( #4301 )
1 year ago
Mike Fährmann
d97b8c2fba
consistent cookie-related names
...
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
1 year ago
Mike Fährmann
ceebacc9e1
remove 'pyopenssl' option
1 year ago
Mike Fährmann
3c2c7e21dd
merge #4319 : [zerochan] fix 'tags' extraction
1 year ago
Mike Fährmann
0ba8d1f168
merge #4312 : [redgifs] add 'niches' extractor
1 year ago
Mike Fährmann
c5565f79f7
merge #4096 : [danbooru] add support for booru.borvar.art instance
1 year ago
Mike Fährmann
63326e3168
[danbooru] add tests for booruvar
1 year ago
Mike Fährmann
5171d8975c
[E621] support 'e6ai.net' ( #4320 )
1 year ago
Mike Fährmann
a996d936d2
[imagefap] fix pagination ( #3013 )
1 year ago
Mike Fährmann
22099422ca
[deviantart] fix shortened URLs ( #4316 )
1 year ago
Mike Fährmann
90231f2d5a
[twitter] add 'tweet-endpoint' option ( #4307 )
...
use the newer TweetResultByRestId only for guests by default
1 year ago
Mike Fährmann
20ed647f6f
[twitter] add 'user' extractor and 'include' option ( #4275 )
1 year ago
Mike Fährmann
86be197d11
[twitter] remove '/search/adaptive.json'
1 year ago
enduser420
d52ed2bc5a
[zerochan] fix 'tags' extraction
1 year ago
enduser420
12cd85658b
[redgifs] add 'niches' extractor
1 year ago
Mike Fährmann
bc9123cfee
[naverwebtoon] fix 'comic' metadata extraction
1 year ago
Mike Fährmann
ab5dde7221
[mangaread] fix 'tags' extraction
1 year ago
Mike Fährmann
c9a82c9313
[erome] ignore duplicate album IDs
1 year ago
Mike Fährmann
c84397023a
[slideshare] fix extraction
1 year ago
Mike Fährmann
ffbbbd3baf
[gelbooru_v01] 'vidyart' -> 'vidyart2'
1 year ago
Mike Fährmann
e40b90e137
merge #4303 : [gelbooru_v01] fix 'source' ( #4302 )
1 year ago
Mike Fährmann
c6b31a2169
[reddit] set default 0.6s delay between requests ( #4292 )
...
to limit API requests to 100 per minute
https://www.reddit.com/r/redditdev/comments/14nbw6g/
1 year ago
Mike Fährmann
20da41018d
[pornhub] set 'accessAgeDisclaimerPH' cookie ( #4301 )
1 year ago
ncaat
75757c4ace
[gelbooru_v01] fix 'source' ( #4302 )
1 year ago
Mike Fährmann
2dd6942d1c
[jpgfish] update domain to 'jpeg.pet'
1 year ago
Mike Fährmann
1137b89ed4
[lineblog] remove module
...
"LINE BLOGは2023年6月29日をもちましてサービスを終了いたしました"
1 year ago
Mike Fährmann
86560fe0cd
[bcy] remove module
...
"The website was shut down on July 12, 2023"
https://danbooru.donmai.us/wiki_pages/bcy
1 year ago
Mike Fährmann
fceabee433
[philomena] use API interface class
...
handle 429 errors and retry after 10min (#4288 )
1 year ago
Mike Fährmann
f079d9a703
[reddit] notify users about registering an oauth application
...
(#4292 , #4253 , #3943 )
1 year ago
Mike Fährmann
fb3d1462b1
merge #4291 : [wikifeet] fix 'tag' extraction
1 year ago
Mike Fährmann
0b08e2e8a8
merge #4287 : [twitter] Fix following extractor not getting all users
1 year ago