e165e6c265
[wallhaven] add 'collections' extractor ( #1351 )
4 years ago
faf561b6ca
[wallhaven] add 'collection' extractor ( #1351 )
4 years ago
5d3d94ba14
[wallhaven] refactor
4 years ago
1a38fae785
add option to use different youtube-dl modules ( fixes #1330 )
...
by setting the 'downloader.ytdl.module' value. For example
{
"downloader": {
"ytdl": {
"module": "yt_dlp"
}
}
}
or '-o module=yt_dlp'
4 years ago
8821dceb79
use __import__() to dynamically load modules
4 years ago
69ea781d32
[mangadex] improve caching of manga results
...
'manga_id' being a string or integer are treated as two different keys
4 years ago
e58039358d
[mangadex] use 'api.mangadex.org' as default API server
...
The caching issues seem to be gone.
(#1290 , #1310 )
4 years ago
fc15930266
[readcomiconline] download high quality image versions
...
(fixes #1347 )
4 years ago
f360778e60
[komikcast] fix extraction
4 years ago
3df527ee2c
update extractor test results
4 years ago
1bd3d7cfb0
[postprocessor:metadata] call expand_path() on custom paths
...
(#1299 )
4 years ago
fe2ec9cf68
[patreon] reduce redirects when fetching campaign ID
4 years ago
29ea54dc41
[patreon] use '"browser": "firefox"' by default ( #1117 )
4 years ago
61fbbd2dae
[exhentai] rename metadata fields to match API results ( #1325 )
...
- gallery_id -> gid
- gallery_token -> token
- title_jp -> title_jpn
- visible -> expunged
- gallery_size -> filesize
- count -> filecount
Also changes the function of the 'metadata' option.
It is now boolean and causes extra data fields from the API to be added
instead of completely replacing the data from HTML when activated.
4 years ago
996bfe4d4b
[hentaicafe] fix manga extractor
...
was broken since 993856b8
4 years ago
5d69e437d0
[twitter] add option to download all media from a conversation
...
(fixes #1319 )
4 years ago
cf5fa75d4c
add 'browser' option ( #1117 )
...
- change default user agent to Firefox ESR 78 on Windows 10
- remove 'ciphers' option
4 years ago
92071d02f4
fix crash when 'base-directory' is an empty string ( #1339 )
4 years ago
970fc2b2b5
allow setting 'filename' & '(base-)directory' to default
...
by setting them to 'None'/'null'
4 years ago
e5735361ed
[exhentai] add 'metadata' option ( #1325 )
...
to select between gallery metadata from 'api' or 'html'
4 years ago
8f095a0980
[exhentai] extract more metadata from gallery pages ( #1325 )
4 years ago
ffce8d85e7
[cyberdrop] update
...
- add test and archive_fmt
- extract more metadata
4 years ago
de0656941b
[twitter] add extractor for followed users ( #1337 )
...
https://twitter.com/USER/following or
https://twitter.com/id:USERID/following
4 years ago
e39aea42cd
fix supportedsites.py for modules without docstring
...
(fixes #1332 )
4 years ago
7b5ee922b7
cyberdrop extractor ( #1328 )
...
* create cyberdrop extractor
* add cyberdrop to list of extractors
* fix formatting
* change class name from CyberdropExtractor to CyberdropAlbumExtractor
* add cyberdrop to list of supported sites
* attempt to clean up diff of supportedsites.rst
* replace regex with functions from text library
4 years ago
5ad2b9c82b
[deviantart] extend 'extra' option
...
also download from embedded DeviantArt posts
4 years ago
560277394e
[downloader:http] add 'headers' option ( #1322 )
4 years ago
6b0ecbf6bc
[hentainexus] add 'orignal' option ( #1322 )
4 years ago
5542a11c46
[twitter] update GraphQL endpoints
4 years ago
e1a12761d7
strip '/' from instance root URLs
4 years ago
595bdaa4be
add extractors for gelbooru v0.1 sites
...
- support https://illusioncards.booru.org/ (closes #426 )
- support https://the-collection.booru.org/ (closes #767 )
- support https://allgirl.booru.org/
- closes #234 , closes #473 , closes #1238
To get gallery-dl to recognize other sites running Gelbooru v0.1
(most sites on booru.org), add one or more entries to the
'gelbooru_v01' block in your config file. For example:
{
"extractor": {
"gelbooru_v01": {
"rozenmaidenbooru": {"root": "http://rm.booru.org "},
"drawfriendsbooru": {"root": "http://drawfriends.booru.org "}
}
}
}
4 years ago
59fd740b47
[tbib] add support for https://tbib.org/ ( #473 , closes #1082 )
4 years ago
08d7934c6e
move extractors from booru.py into their own gelbooru_v02 module
4 years ago
d656892670
remove cloudflare.py
...
The old IUAM challenge doesn't get used anymore, i.e. code to bypass it
is pointless, and the 'is_...()' checks are simple enough to directly
include them in 'extractor.request()'.
4 years ago
65ca923b4e
fix 'whitelist' option for BaseExtractor instances
4 years ago
fbfcbcbf57
Merge branch '1.17.0'
4 years ago
6e40585fb1
release version 1.16.5
4 years ago
ba693d8686
[patreon] skip posts without view permission ( #1316 )
4 years ago
dcbd995346
[vanillarock] fix metadata extraction
4 years ago
4b1cda4cf7
[paheal] fix metadata extraction
4 years ago
2919d78bfc
update extractor test results
4 years ago
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
4 years ago
79c0fc249b
[mangadex] add 'api-server' option ( #1309 )
...
and change the API server back to 'https://mangadex.org/api ' for now
4 years ago
96a51ff169
[sankaku] update invalid-token detection ( fixes #1309 )
4 years ago
b3cd970d87
[postprocessor:metadata] fix crash with 'extension-format'
...
Using the 'extension-format' option for events where no filename
extension is available caused a crash.
(fixes #1285 )
4 years ago
23be48427c
[deviantart] fix 'folders' option ( closes #1302 )
...
don't assume parent folders are listed before their children
4 years ago
ca6b0fc2ac
[imagehosts] cleanup
4 years ago
95a66bdad6
[imgclick] add 'image' extractor ( closes #1307 )
...
basically reverts b0e8daf415
4 years ago
fc78210725
[kemonoparty] include 'service' in directories and archive keys
4 years ago
c386a9fabf
[kemonoparty] fix absolute file URLs
4 years ago
Mike Fährmann