ClosedPort22
ce8dbb1ccc
[twitter] fix crash when using 'expand' and 'syndication'
...
caused by KeyError: 'conversation_id_str'
2 years ago
Mike Fährmann
d651d45239
implement specifying ranges in slice notation ( #918 , #2865 )
...
e.g.
- '1:101' or ':101' or ':101:' for files 1 to 100
- '1::2' or '::2' for every second file
- '1:101:5' or ':101:5' for files 1, 6, 11, ..., 91, 96
(the second argument specifies the first index NOT included)
2 years ago
pi_allen
64902f518e
[docs] Update links and fix field typo
2 years ago
ClosedPort22
5d5ea58887
[twitter] update docs for 'quoted' & 'unique'
2 years ago
blankie
f82ee93676
[danbooru] extract uploader metadata (if metadata is set)
2 years ago
Mike Fährmann
1800bd7d14
allow '*-filter' options to be a list of expressions
2 years ago
Mike Fährmann
73ab5d84c0
update docs/configuration.rst
2 years ago
ClosedPort22
dd4a4a3fa6
[e621] softcode the pagination threshold
2 years ago
ClosedPort22
d0ad6d0e67
[e621] implement manual pagination mode
2 years ago
Mike Fährmann
6b6f886dcf
[bunkr] update domain ( #3391 )
...
and improve bunkr/app.bunkr handling
2 years ago
Mike Fährmann
dfe7b23579
support Firefox containers for --cookies-from-browser ( #3346 )
2 years ago
Mike Fährmann
80102fa367
[downloader:http] add 'retry-codes' option ( #3313 )
2 years ago
ClosedPort22
b14b33f19e
Implement `version-metadata` option ( #3201 )
2 years ago
Mike Fährmann
6cb12f513b
[nitter] support quoted Tweets
...
- distinguish between regular and quoted Tweets and media
- add 'quoted' option and metadata field
2 years ago
Mike Fährmann
a41d093bb1
[nitter] add 'retweets' option ( #3278 )
2 years ago
Mike Fährmann
e31d12139c
[nitter] add 'videos' option ( #3279 )
...
with the same semantics as for twitter
2 years ago
Mike Fährmann
501d9bccfe
[artstation] add 'max-posts' option ( #3270 )
2 years ago
Mike Fährmann
b1ad6f2289
[artstation] add 'pro-first' option ( #3273 )
2 years ago
Mike Fährmann
6b97dcf2e0
[postprocessor:metadata] add 'private' option
2 years ago
Mike Fährmann
6379157543
[instagram] use REST API by default
...
regardless of logged in status
2 years ago
enduser420
7897f68225
[wallhaven] update 'user' extractor ( #3226 )
...
* [wallhaven] update 'user' extractor
* [wallhaven] update 'configuration.rst'
add 'extractor.wallhaven.include' entry
* [wallhaven] add 'wallhaven.include' in gallery-dl.conf
2 years ago
Mike Fährmann
9f06e79868
implement '"user-agent": "browser"' ( #2636 )
2 years ago
Mike Fährmann
8d543b040d
update docs
...
- document '"mode": "jsonl"' for metadata pp
- remove 'username' and 'password' from 'instagram'
- add 'ytdl' example (#3180 )
2 years ago
Mike Fährmann
171262c1b6
[instagram] remove login support
...
broken feature that I cannot get to work anymore
2 years ago
Mike Fährmann
895f36e53b
[postprocessor:metadata] add 'open' and 'encoding' options
2 years ago
Mike Fährmann
870e6a48a0
implement 'http-metadata' option
...
or at least attempt to.
2 years ago
Mike Fährmann
bca9f965e5
[downloader:http] add 'chunk-size' option ( #3143 )
...
and double the previous default from 16384 (2**14) to 32768 (2**15)
2 years ago
Mike Fährmann
c12a97bcde
[postprocessor] add 'post-after' event ( #3117 )
2 years ago
Mike Fährmann
7c6af27eb8
[tumblr] add 'fallback-*' options ( #2957 )
...
specifically 'fallback-delay' and 'fallback-retries'
and change default number of retries to 2 (down from 3)
2 years ago
Mike Fährmann
cf86f68864
[instagram] add 'avatar' extractor ( #929 , #1097 , #2992 )
2 years ago
Mike Fährmann
52d1eb928d
[pixiv] extend 'metadata' option ( #3057 )
...
make it usable for all 'pixiv' extractors
2 years ago
Mike Fährmann
0714274f1f
[instagram] remove 'channel' extractor
2 years ago
Mike Fährmann
f1f89b2436
[tumblr] add 'offset' option
2 years ago
Mike Fährmann
15a4d7696f
[docs] update 'adjust-extensions' explanation ( #3031 )
2 years ago
Mike Fährmann
7f30a0d7a7
add 'path-extended' option ( #3021 )
2 years ago
Mike Fährmann
14717f3fc9
[deviantart] add 'group' option ( #3018 )
...
disabling this option allows to better download from deleted accounts
2 years ago
enduser420
f7ba19a1c0
[nana] add 'nana' extractors ( #2967 )
2 years ago
Mike Fährmann
4089bceddd
[sankaku] implement 'refresh' option ( #2958 )
2 years ago
Mike Fährmann
aa49bf13d2
[instagram] add 'api' option
2 years ago
Mike Fährmann
ac45ed2764
[skeb] implement 'filters' option ( #2945 )
2 years ago
Mike Fährmann
0393e59535
[newgrounds] add 'games' extractor ( #2955 )
2 years ago
Mike Fährmann
e99a9b2aff
[twitter] improve 'cards-blacklist' ( #2875 )
...
allow blacklisting domains and 'name:domain',
where 'domain' depends on a card's 'vanity_url' value
2 years ago
Mike Fährmann
46fe469c53
[tumblr] implement 'ratelimit' option ( #2919 )
2 years ago
Mike Fährmann
b36125333f
[postprocessor:zip] implement 'files' option ( #2872 )
2 years ago
Mike Fährmann
3cb8327c60
[zerochan] add 'metadata' option ( #2861 )
2 years ago
blankie
9745b48830
[tumblr] attempt to fetch high-quality inline images ( #2877 )
...
* [tumblr] attempt to fetch high-quality images (again)
Fixes #1846 , and fixes #1344
* slight refactor
* update configuration.rst entry
2 years ago
Mike Fährmann
4d78ca89db
[twitter] add 'cards-blacklist' option ( #2875 )
2 years ago
Mike Fährmann
f16fbe9f93
document 'extractor.twitter.expand' ( #2848 )
2 years ago
enduser420
574e38a287
[kemonoparty] add 'favorites' option ( #2826 ) ( #2831 )
...
* [kemonoparty] add 'favorites' option (#2826 )
* [kemonoparty] add regex for the url parameter and fallback on the config
option
* [kemonoparty] simplify
2 years ago
Martin Juhasz
9ea521bec5
[oauth] add host config option ( #2806 )
2 years ago
Mike Fährmann
df1c643dda
[tumblr] attempt to extract full-resolution photos
...
- for photos with apparent width == 2048 or height == 3072
- can be disabled with 'original' option
2 years ago
Mike Fährmann
a69f198ac9
[wallhaven] implement 'metadata' option ( #2803 )
2 years ago
Mike Fährmann
7d1a95ada6
implement 'path-metadata' option ( #2734 )
2 years ago
Mike Fährmann
8cf5981ded
[skeb] add option to download 'article' images ( #1031 )
2 years ago
Mike Fährmann
98af5a0409
[zerochan] implement login with username & password ( #1434 )
2 years ago
Mike Fährmann
0c73914848
[postprocessor:metadata] implement 'mode: modify' ( #2640 )
2 years ago
Mike Fährmann
f3de6b7a87
[postprocessor:metadata] implement 'mode: delete' ( #2640 )
2 years ago
Mike Fährmann
eb68d45544
add global 'warnings' option ( #2762 )
2 years ago
Mike Fährmann
f225247670
[gelbooru] add support for `api_key` and `user_id` ( #2767 )
2 years ago
Mike Fährmann
74865adae5
implement 'format-separator' option ( #2737 )
...
a global option, that servers as a workaround for shortcomings due to
lack of a proper format string parser
2 years ago
bradenhilton
117eeefda0
[postprocessor:mtime] add 'value' option ( #2739 )
2 years ago
Mike Fährmann
1d14928bd9
[twitter] ignore previously seen Tweets ( #2712 )
...
occurs primarily for /with_replies results when logged in
2 years ago
Mike Fährmann
4b2a0a0eda
[twitter] implement 'strategy' option ( #2712 )
...
to be able to better control what Tweets get used an returned
for twitter.com/USER URLs.
2 years ago
Mike Fährmann
124b5c6410
[postprocessor:ugoira] enable 'mtime' by default ( #2714 )
2 years ago
Mike Fährmann
3a5d5c3a91
update default User-Agent header to Firefox 102 ESR
...
snd update headers and ciphers for "browser": "firefox"
2 years ago
Mike Fährmann
9d8e99af80
[itaku] support videos ( #1842 )
2 years ago
Mike Fährmann
9c8d895d19
[twitter] implement 'csrf' option ( #2676 )
2 years ago
Mike Fährmann
6db77d4656
[weibo] support '?tabtype=video' listings ( #2601 )
2 years ago
Mike Fährmann
4b78bd423f
[paheal] add 'metadata' option ( #2641 )
2 years ago
Mike Fährmann
57508d3bb7
[weibo] support all different 'tabtype' listings ( #686 , #2601 )
2 years ago
HRXN
6d0aa8c0f3
[docs/configuration.rst] Fix small typo ( #2649 )
2 years ago
Mike Fährmann
e0ac358aa5
[gofile] fix 401 Unauthorized errors ( #2632 )
2 years ago
Mike Fährmann
4bf5bc2403
[weibo] support 'livephoto' entries ( #2146 )
2 years ago
Mike Fährmann
5b43faffed
[postprocessor:metadata] write to stdout by setting filename to "-"
...
(#2624 )
2 years ago
Mike Fährmann
603af48265
implement 'output.ansi' option ( #2628 )
2 years ago
Mike Fährmann
915dba8345
[twitter] improve results for regular user URLs
...
- continuation of 3346f58a
- use media timeline results (or tweet timeline if retweets are enabled)
plus search results starting from the last tweet id of the first
timeline, similar to how Twitter Media Downloader operates
- the old behavior can be forced by appending '/tweets' to a user URL,
like with '/media' (https://twitter.com/USER/tweets )
although there should be no need to ever do that
2 years ago
Mike Fährmann
9df4e0f65b
[twitter] disable 'cards' by default
2 years ago
Mike Fährmann
79dce8ae68
[weasyl] implement 'metadata' option ( #2610 )
2 years ago
Mike Fährmann
6b6eb0b8f6
[lolisafe] implement 'domain' option ( #2575 )
2 years ago
Mike Fährmann
6742f3bc1e
implement --cookies-from-browser ( #1606 )
...
most of the code is adapted from yt-dlp's implementation
and *should* work the same.
2 years ago
Mike Fährmann
61887c895b
implement 'output.colors' options ( #2532 )
2 years ago
Mike Fährmann
84756982e9
[pixiv] implement 'include' option
...
- split 'user' extractor and its 'avatar' and 'background' options into
separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
https://www.pixiv.net/en/users/ID/avatar
as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
the same effect as before
2 years ago
Mike Fährmann
d11e2191ae
[nijie] support /history_nuita.php listings ( closes #2541 )
2 years ago
Mike Fährmann
61afa973b7
use extended format strings for archive keys
2 years ago
Mike Fährmann
9e6ff42a9d
[pixiv] implement 'background' option ( #623 , #1124 , #2495 )
2 years ago
Mike Fährmann
97e8a15295
[deviantart] implement 'pagination' option ( #2488 )
2 years ago
Mike Fährmann
12bd9ba33a
[readcomiconline] add 'quality' option ( #2467 )
2 years ago
Mike Fährmann
24ea1398bc
[postprocessor:ugoira] do not auto-select image2 demuxer ( #2492 )
2 years ago
Mike Fährmann
1171911dc3
[twitter] add 'syndication' option ( #2354 )
...
to fetch age-restricted content using Twitter's syndication API
3 years ago
loragja
7e545a3ae9
[gofile] add gofile.io extractor ( #2364 )
...
* Add gofile extractor
* add gofile extractor to module list
* add support for tiny monitors and ancient python versions
* seriously, f-strings are not *that* new...
* i love flake8 :)
* add 'api-token' and 'recursive' options
* add tests
3 years ago
Mike Fährmann
5c2d953766
[postprocessor:ugoira] auto-select demuxer by default
3 years ago
Mike Fährmann
37d584a9b2
[hitomi] update metadata extraction ( fixes #2444 )
...
remove 'hitomi.metadata' option, as it is no longer necessary
to make additional HTTP requests to fetch all metadata.
3 years ago
Mike Fährmann
e718dd7b32
[postprocessor:ugoira] support setting timecodes with mkvmerge
...
by selecting the "mkvmerge" demuxer
(#1550 )
3 years ago
Mike Fährmann
71bba774da
respect 'output.private' in '-K/--list-keywords' output
3 years ago
Mike Fährmann
ba69fb669d
[kemonoparty] add 'duplicates' option ( closes #2440 )
3 years ago
Mike Fährmann
40ce505420
[postprocessor:ugoira] add 'mtime' option ( #2307 )
3 years ago
Mike Fährmann
9bd27b1b8d
[postprocessor:metadata] implement archive options ( #2421 )
...
'archive', 'archive-format', and 'archive-prefix'
3 years ago
Mike Fährmann
f8230dde43
[instagram] add 'previews' option ( #2135 )
3 years ago
Mike Fährmann
fc277fa45f
[seiga] require authentication with 'user_session' cookie ( #2372 )
...
Login with username & password would now require entering a 2FA token.
see also 7b009cc893
3 years ago
Mike Fährmann
47cf05c4ab
refactor proxy handling code ( #2357 )
...
- allow gallery-dl proxy settings to overwrite environment proxies
- allow specifying different proxies for data extraction and download
- add 'downloader.proxy' option
- '-o extractor.proxy=–PROXY_URL -o downloader.proxy=null'
now has the same effect as youtube-dl's '--geo-verification-proxy'
3 years ago