Mike Fährmann
a12ce2bb41
[deviantart] fix 'deviation' extraction ( #2981 )
2 years ago
Mike Fährmann
36afb519b3
[instagram] prevent crash on empty user profile
2 years ago
Mike Fährmann
b57015cf0a
[postprocessor:metadata] assume 'mode: custom' when format is set
...
{"name": "metadata", "format": "foobar"}
will now implicitly use mode:custom and no longer mode:json like before
2 years ago
enduser420
f0321f423d
[2chen] Add 2chen.moe extractor ( #2707 )
...
* [2chen] Add 2chen.moe extractor
* change "==" to is
* fix for "test_unique_pattern_matches"
* fix regex pattern and group matching
* fix regex again
* [2chen] add 'reply_no' and 'hash' metadata and change 'filename_fmt'
also made an entry in supportedsites.md
* [2chen] unescape 'title'
* [2chen] partition() -> rpartition()
* [2chen] extract 'date' and 'name' metadata
* [2chen] remove 'offset' argument
* [2chen] do some changes
* [2chen] do some more changes
* [2chen] unescape 'name' and 'filename'
2 years ago
enduser420
f7ba19a1c0
[nana] add 'nana' extractors ( #2967 )
2 years ago
Mike Fährmann
fce6642699
[instagram] restore warnings for private profiles ( #3004 )
2 years ago
Mike Fährmann
3e65645cfa
[instagram] restore 'cursor' functionality ( #2991 )
2 years ago
Mike Fährmann
b8d268f57e
allow '/' and '?' in URL queries
2 years ago
Mike Fährmann
60cce7462c
release version 1.23.2
2 years ago
Mike Fährmann
7b5dad075d
[fappic] fix extraction
2 years ago
Mike Fährmann
78694a61bb
[kemonoparty] restore 'favorites' API endpoints ( #2994 )
2 years ago
Mike Fährmann
5fd4374036
[sankaku] improve 429 and tag limit handling
2 years ago
Mike Fährmann
b84982b2f9
[kemonoparty] send Referer headers ( #2989 , #2990 )
2 years ago
blankie
98f67ae333
[instagram] add 'count' metadata field ( #2979 )
2 years ago
Mike Fährmann
4089bceddd
[sankaku] implement 'refresh' option ( #2958 )
2 years ago
Mike Fährmann
779e75c6f8
[kemonoparty] fix attachment IDs overwriting post IDs ( #2984 )
...
regression from 09a5cc61
2 years ago
Mike Fährmann
e1d714943b
[tumblr] catch exception when updating image token ( #2957 )
2 years ago
Mike Fährmann
e3a03f335c
[instagram] fix GraphQL bugs
2 years ago
Mike Fährmann
6c76b5f90c
[deviantart] fix extraction ( #2981 , #2983 )
...
send a 'csrf_token' with every Eclipse API request
2 years ago
Mike Fährmann
f728b5ca06
[tumblr] add fallback for failed higher-resolution images ( #2957 )
2 years ago
Mike Fährmann
6992d01e19
[artstation] support search filters ( #2970 )
2 years ago
Mike Fährmann
194803f3a7
[plurk] fix extraction ( #2977 )
2 years ago
Mike Fährmann
63e0924927
[pixiv] add 'series' extractor ( #2964 )
2 years ago
Mike Fährmann
aafea0c4f8
[artstation] fix searches ( #2970 )
2 years ago
Mike Fährmann
2c67bee5c4
[instagram] update
...
- reorder some functions and extractors
- add missing GraphQL endpoints
- fix some GraphQL bugs
2 years ago
Mike Fährmann
aa49bf13d2
[instagram] add 'api' option
2 years ago
Mike Fährmann
6f77193a24
[instagram] move API related code into separate classes
...
may contain bugs and is probably incomplete for the GraphQL variant
2 years ago
Mike Fährmann
ac45ed2764
[skeb] implement 'filters' option ( #2945 )
2 years ago
Mike Fährmann
32c30754d1
[tumblr] warn when unable to fetch higher-resolution images ( #2957 )
...
and download the smaller version
instead of failing with a 404 error
2 years ago
Mike Fährmann
ff532d6c3c
[newgrounds] extract 'type' metadata
2 years ago
Mike Fährmann
0393e59535
[newgrounds] add 'games' extractor ( #2955 )
2 years ago
Mike Fährmann
68f11e02a9
[skeb] add 'search_tags' metadata to search results ( #2945 )
2 years ago
Mike Fährmann
1378cbb8dd
[myportfolio] use fallback when no images are found ( #2959 )
2 years ago
Mike Fährmann
850608551c
[sankaku] detect expired links ( #2958 )
2 years ago
Mike Fährmann
09a5cc6103
[kemonoparty] add 'count' metadata field ( #2952 )
2 years ago
Mike Fährmann
89610a49dc
[instagram] use REST API endpoint for user feeds ( #2666 )
...
With this change, everything is using the newer REST API endpoints
providing higher-quality photos except the now obsolete '/channel' feed.
2 years ago
Mike Fährmann
6737499dbd
[instagram] use REST API endpoint for saved posts ( #2911 )
...
provides 'username' and 'fullname'
as well as higher-quality images
2 years ago
Mike Fährmann
50e3179c56
[instagram] update _user_by_screen_name()
...
use REST API
2 years ago
Mike Fährmann
3dacfb3c56
[instagram] update API headers
2 years ago
Mike Fährmann
4b2a006871
[skeb] add 'search' extractor ( #2945 )
2 years ago
Mike Fährmann
94b34f460e
[exhentai] add slash to the end of gallery URLs ( #2947 )
2 years ago
Mike Fährmann
2787c8511a
[mastodon] warn about moved accounts ( #2939 )
2 years ago
Mike Fährmann
d699310fdf
[blogger] add 'label' or 'query' metadata fields ( #2930 )
...
for '/search/label/…' or '/search?q=…' URLs
2 years ago
Mike Fährmann
eef50c1f28
[blogger] split 'search' extractor ( #2930 )
2 years ago
Mike Fährmann
64202dd012
release version 1.23.1
2 years ago
Mike Fährmann
d29fb94098
[bunkr] use 'media-files' servers for m4v and mov files ( #2925 )
2 years ago
enduser420
bd846abba0
[hotleak] add hotleak extractor ( #2909 ) ( #2890 )
2 years ago
Mike Fährmann
e99a9b2aff
[twitter] improve 'cards-blacklist' ( #2875 )
...
allow blacklisting domains and 'name:domain',
where 'domain' depends on a card's 'vanity_url' value
2 years ago
Mike Fährmann
aaf6992bae
[twitter] fix new-style '/card_img/' URLs
2 years ago
Mike Fährmann
40baa77630
[twitter] provide proper 'date' for syndication results ( #2920 )
2 years ago
Mike Fährmann
46fe469c53
[tumblr] implement 'ratelimit' option ( #2919 )
2 years ago
Mike Fährmann
d0b73fec14
[flickr] add support for secure.flickr.com ( #2910 )
2 years ago
Mike Fährmann
35eddaa94e
[reddit] prevent exception with empty submission URLs ( #2913 )
2 years ago
Mike Fährmann
464ea90d14
[exhentai] guess extension for original files ( #2842 )
...
makes it possible to sometimes, when guessed correctly ('.jpg'),
skip an original file download without costing image limit points
2 years ago
Mike Fährmann
551fdf7ad7
[exhentai] move 509 check into its own function
2 years ago
Mike Fährmann
7a799df17f
[tumblr] pre-compile regular expressions
2 years ago
Mike Fährmann
73a52a95b0
update Cloudflare IUAM detection
2 years ago
Mike Fährmann
673b6f1218
[poipiku] use 'img-org.poipiku.com' as image domain ( #2796 )
2 years ago
Mike Fährmann
4ca1a6e5f3
[bunkr] fix extraction ( #2903 )
2 years ago
Mike Fährmann
8b76149521
[exhentai] improve 509.gif detection ( #2901 )
2 years ago
Mike Fährmann
bdad9c40dd
remove whitespace before comments in input file URLs ( #2808 )
2 years ago
Mike Fährmann
b36125333f
[postprocessor:zip] implement 'files' option ( #2872 )
2 years ago
Mike Fährmann
2ed58029f9
{paheal[ add proper support for videos ( #2892 )
2 years ago
Mike Fährmann
444dfb4aa6
[instagram] add 'highlight_title' and 'date' metadata
...
to highlight posts (#2879 )
2 years ago
Mike Fährmann
7f764ebee6
[redgifs] "fix" download URLs ( #2884 )
2 years ago
Mike Fährmann
3cb8327c60
[zerochan] add 'metadata' option ( #2861 )
2 years ago
blankie
9745b48830
[tumblr] attempt to fetch high-quality inline images ( #2877 )
...
* [tumblr] attempt to fetch high-quality images (again)
Fixes #1846 , and fixes #1344
* slight refactor
* update configuration.rst entry
2 years ago
Mike Fährmann
daef91c925
[smugmug] update default API credentials ( #2881 )
...
The old key lacked v2 access and I'm unable to accept
the new terms of service since my old account got deleted
2 years ago
Mike Fährmann
4d78ca89db
[twitter] add 'cards-blacklist' option ( #2875 )
2 years ago
Mike Fährmann
4d7cb0bf56
[twitter] general support for unified cards ( #2875 )
...
just removing the 'type' check seems to work
2 years ago
Mike Fährmann
7ddfff957c
[twitter] support "image_website" unified cards ( #2875 )
2 years ago
Mike Fährmann
51f14223a8
release version 1.23.0
2 years ago
Mike Fährmann
2eb0ddd083
[hitomi] fix error when number of tag results is multiple of 25
...
(#2870 )
2 years ago
Mike Fährmann
3cebf787c4
[slideshare] fix metadata extraction
2 years ago
Mike Fährmann
da11fb32d0
update extractor test results
2 years ago
Mike Fährmann
636d03df95
[nijie] reduce cache maxage to 90 days
2 years ago
Mike Fährmann
f375ec0ffa
[vsco] fix 'collection' extraction
2 years ago
Mike Fährmann
8672f8a2b9
[skeb] fix archive_ids for thumbnails and article images
...
8cf5981ded (commitcomment-82316040)
2 years ago
Mike Fährmann
69995d789b
Revert "[twitter] use '{author[name]' in default directory names"
...
This reverts commit 9ad3cdc5d8
.
2 years ago
Mike Fährmann
946643c23c
[hitomi] use maxage for gg.js cache ( #2863 )
...
cached values become invalid after 1-2 hours
2 years ago
Mike Fährmann
d508b2c049
[gelbooru] implement 'pool' pagination ( #2853 )
2 years ago
Mike Fährmann
67a2efb885
[rule34] implement 'pool' pagination ( #2853 )
2 years ago
Mike Fährmann
70dc4ce911
[skeb] ignore article images with empty URL
...
8cf5981ded (commitcomment-81980633)
2 years ago
Mike Fährmann
f362d4a3c7
[e621] fix 'popular' extraction
2 years ago
Mike Fährmann
7e385ed63e
[foolfuuka] update domains
...
- remove nyafuu
- add rozenarcana (https://archive.alice.al/ )
- add tokyochronos (https://www.tokyochronos.net )
2 years ago
Mike Fährmann
6ba72b6bc6
[twitter] ignore invalid user entries ( #2850 )
2 years ago
Mike Fährmann
67bad04dda
[formatter] add 'g' conversion to sluGify a string ( #2410 )
2 years ago
blankie
e4cff67aaa
[tumblr] add count metadata field ( #2804 )
...
Fixes #2778
2 years ago
enduser420
574e38a287
[kemonoparty] add 'favorites' option ( #2826 ) ( #2831 )
...
* [kemonoparty] add 'favorites' option (#2826 )
* [kemonoparty] add regex for the url parameter and fallback on the config
option
* [kemonoparty] simplify
2 years ago
Mike Fährmann
a799fae2df
[catbox] add 'album' extractor ( #2410 )
...
adapted from https://github.com/mikf/gallery-dl/pull/2805
- rewrite using GalleryExtractor
- extract more metadata
- match lolisafe names
- add test
2 years ago
Mike Fährmann
264f1336ad
[twitter] unescape '+' in search queries ( #2226 )
...
... and do not raise exception if searched user does not exist
2 years ago
Mike Fährmann
6990ad0ba8
[formatter] do NOT apply :J to strings ( #2833 )
2 years ago
Mike Fährmann
590f2e270c
[postprocessor:metadata] fix error with '..' in directory
2 years ago
Mike Fährmann
21ff77fea0
[zerochan] extract more metadata for single posts
...
Neither HTML pages nor RSS feed entries have *all* metadata.
It might be necessary to do 1-2 extra HTTP requests to grab everything.
2 years ago
Mike Fährmann
391aecf219
[instagram] provide 'date' for directories ( #2830 )
2 years ago
Martin Juhasz
9ea521bec5
[oauth] add host config option ( #2806 )
2 years ago
Mike Fährmann
9ad3cdc5d8
[twitter] use '{author[name]' in default directory names
...
with the changes to 'user' (749802c7
),
'{user[name]' with enabled retweets / quote tweets
would put a lot of them in a wrong directory
2 years ago
Mike Fährmann
764906e1af
allow tabstops as whitespace before input file comments ( #2808 )
2 years ago
Mike Fährmann
1c89ccb27d
[weibo] prevent errors when paginating over album entries ( #2817 )
2 years ago
Mike Fährmann
a27b17481f
[tumblr] restrict condition for calling _original_image
2 years ago