8cf5981ded
[skeb] add option to download 'article' images ( #1031 )
2 years ago
43ec315a7f
[deviantart] use public access token for journals ( #2702 )
...
and retry with a private token if needed
2 years ago
3f08a91131
[bunkr] fix extraction ( #2788 )
...
... again
2 years ago
5038893cdd
[blogger] emit metadata for posts without files ( #2789 )
2 years ago
98af5a0409
[zerochan] implement login with username & password ( #1434 )
2 years ago
3a8addfe45
[zerochan] add 'tag' and 'image' extractors ( #1434 )
2 years ago
e660e48a60
[vk] prevent exceptions for broken/invalid photos ( #2774 )
2 years ago
f559943d77
[instagram] fix empty 'params' in '_pagination_api()'
2 years ago
1540d0e695
[twitter] use filter:links ( #2766 )
2 years ago
8d0801ad8e
[twitter] fall back to unfiltered search ( #2766 )
2 years ago
0aa8345a13
[mastodon] allow downloading without access token ( #2782 )
...
Most mastodon instances allow accessing /api/v1/accounts/XXXX/statuses and api/v1/statuses/XXXX without an API access token.
This commit allows users to download at least some links from such a mastodon instance that does not already have access tokens hard-coded into the extractor.
User extractor only works on links that include the user id such as https://mastodon.tld/@id:12345 . Status links work as-is.
2 years ago
ea5ffb19a6
fanbox: download cover images in original size ( #2784 )
2 years ago
977d53b640
[Instagram] Add support for user's saved collection ( #2769 )
...
* [Instagram] Add support for user's saved collection
* [Instagram] Run formatter
* [Instagram] Simplify collection_id retrieval and add metadata
* [Instagram] Fix bug when params is not passed to _pagination_api
2 years ago
5b63df46c0
[tumblr] attempt to get higher-quality images ( #2761 )
2 years ago
59b16b3f70
[artstation] add 'num' and 'count' metadata fields ( #2764 )
2 years ago
0c73914848
[postprocessor:metadata] implement 'mode: modify' ( #2640 )
2 years ago
f3de6b7a87
[postprocessor:metadata] implement 'mode: delete' ( #2640 )
2 years ago
eb68d45544
add global 'warnings' option ( #2762 )
2 years ago
f225247670
[gelbooru] add support for `api_key` and `user_id` ( #2767 )
2 years ago
77bdd8fe0f
[twitter] implement constant 'user' for 'from:…' searches
2 years ago
a267a05a3f
[twitter] update 'quote_id' and 'quote_by'
...
- 'quote_id' is now non-null for quoted Tweets and has the ID of the
quoting Tweet, instead the other way round like before
- 'quote_by' is now the 'screen_name' of the quoting user
(was the same the new 'quote_id' is now)
2 years ago
749802c7bd
[twitter] update 'user' and 'author' fields
...
- 'author' is always the user who authored a tweet
- 'user' is always the user specified in the input URL
or equal to 'author' when the former is not given
2 years ago
51b1999d4b
release version 1.22.4
2 years ago
a566e63cdf
[tumblr] support '/blog/view' URLs ( #2760 )
2 years ago
46f11a3118
[bunkr] fix extraction ( #2732 )
...
move bunkr.is code to its own module
2 years ago
baf3815ebd
[nozomi] small code optimizations
2 years ago
9704c04172
[postprocessor:zip] ensure target directory exists ( #2758 )
2 years ago
836402bf58
[twitter] unescape content ( #2756 ) ( #2757 )
...
Fixes #2756
2 years ago
62cc47755b
[nozomi] reduce memory consumption during searches ( #2754 )
...
only load and use the entire 'index.nozomi' database
if there are only negative search terms
2 years ago
467a2a4d35
[instagram] add 'pinned' metadata field ( #2752 )
...
'pinned' is a list of user IDs for which a post is pinned
and empty if not pinned anywhere.
2 years ago
fe2b3d57d4
[komikcast] update domain
2 years ago
4e11ca737e
[hentaifoundry] fix metadata extraction
2 years ago
f2e59cc906
[slideshare] fix 'description' extraction
2 years ago
31e868fca1
[khinsider] extract 'platform' metadata
2 years ago
c6a9bab019
update extractor test results
2 years ago
539e3bbed9
[weibo] handle invalid/broken status objects
2 years ago
32c75d12e8
[sankaku] rewrite URLs to s.sankakucomplex.com ( #2746 )
2 years ago
d5ded11aa8
[pixiv] fix default filenames for backgrounds
2 years ago
e1f501ed14
[mangakakalot] update domain
2 years ago
2dc57637cf
[foolfuuka] remove archive.wakarimasen.moe
2 years ago
98744977cf
[itaku] fix 'date' parsing
2 years ago
b590774f67
[twitter] add 'count' metadata field ( #2741 )
2 years ago
7c0505868c
[kemonoparty] ensure all files have an 'extension' ( #2740 )
2 years ago
74865adae5
implement 'format-separator' option ( #2737 )
...
a global option, that servers as a workaround for shortcomings due to
lack of a proper format string parser
2 years ago
117eeefda0
[postprocessor:mtime] add 'value' option ( #2739 )
2 years ago
90ae48c40c
[formatter] implement 'O' format specifier ( #2736 )
...
to apply a UTC offset to 'date' values and other datetime objects
2 years ago
e4f48cc810
make it easier to disable default 'browser' settings
...
Previously it was necessary to set 'browser' to a non-empty, non-string
value to disable any default 'browser' value.
Now '-o browser=' or '-o browser=false' is enough.
2 years ago
92b75bcdce
limit path length for --write-pages output on Windows ( #2733 )
2 years ago
04bed1eba3
[formatter] allow for custom "format" functions ( #2721 )
2 years ago
311e9383af
[pinterest] handle section pins with separate extractors ( #2684 )
2 years ago
1d14928bd9
[twitter] ignore previously seen Tweets ( #2712 )
...
occurs primarily for /with_replies results when logged in
2 years ago
4b2a0a0eda
[twitter] implement 'strategy' option ( #2712 )
...
to be able to better control what Tweets get used an returned
for twitter.com/USER URLs.
2 years ago
5806a1851e
add --no-postprocessors command-line option ( #2725 )
2 years ago
c794777600
[newgrounds] prevent exception on empty results ( #2727 )
2 years ago
36ead45546
[itaku] fix caching bug ( #1842 )
...
ItakuApi.user() would always return the first user it was called with,
regardless of its 'username' argument.
2 years ago
124b5c6410
[postprocessor:ugoira] enable 'mtime' by default ( #2714 )
2 years ago
127a190c94
[itaku] categorize sections by group ( #1842 )
2 years ago
de20cadc68
add 'brotli' as optional dependency ( #2716 )
...
only send 'Accept-Encoding: br' if supported
2 years ago
37453a9528
[newgrounds] only login if necessary ( #2715 )
2 years ago
86a7dad081
release version 1.22.3
2 years ago
7b073bf9ef
Revert "[twitter] improve strategy for user URLs ( #2665 )"
...
'user_tweets_and_replies' was a mistake
2 years ago
3a5d5c3a91
update default User-Agent header to Firefox 102 ESR
...
snd update headers and ciphers for "browser": "firefox"
2 years ago
1f9ff518ad
release version 1.22.2
2 years ago
f8cfc3b08a
[skeb] add 'following' extractor ( #2698 )
2 years ago
367a491128
[vk] get URLs from *_src entries ( #2535 )
...
https://github.com/mikf/gallery-dl/issues/2535#issuecomment-1166566986
2 years ago
54525d2e21
[formatter] implement slice operator as format specifier
...
this allows using a slice operator alongside other (special) format
specifiers like J, to first join list elements to a string and then
trimming that with a slice.
{tags:J, /[:50]}
2 years ago
241e82e18d
[horne] add support for horne.red ( #2700 )
2 years ago
7af4d2047b
[instagram] improve metadata generated by _parse_post_api()
...
(#2695 )
2 years ago
3f50e2fb5f
[poipiku] add simple password support ( #1602 )
2 years ago
9d8e99af80
[itaku] support videos ( #1842 )
2 years ago
c8ec2c4e85
[itaku] add 'title' to default filenames ( #1842 )
2 years ago
e0c60a1206
[itaku] metadata cleanup ( #1842 )
...
- parse 'date_added' as 'date'
- simplify 'tags', 'categorized_tags', and 'sections'
2 years ago
27e8078fb7
[poipiku] add 'user' and 'post' extractors ( #1602 )
2 years ago
1aae9f2b71
[downloader:ytdl] update _set_outtmpl() ( fixes #2692 )
...
bf1824b391
2 years ago
fa902cd54d
[itaku] add 'gallery' and 'image' extractors ( #1842 )
2 years ago
d6c6c8a4a0
[twitter] improve '"replies": "self"' ( #2665 )
...
If a username is given in the input URL,
only download from replies by that user.
2 years ago
9c8d895d19
[twitter] implement 'csrf' option ( #2676 )
2 years ago
08db8435f1
[twitter] fix pagination for conversion tweets
...
a relic from the switch to GraphQL API
2 years ago
78d83345d3
[cyberdrop] add fallback URLs ( #2668 )
2 years ago
834e900037
[unsplash] add collection_title and …_id metadata fields ( #2670 )
2 years ago
6db77d4656
[weibo] support '?tabtype=video' listings ( #2601 )
2 years ago
1da3ccf608
[twitter] implement 'expand' option ( #2665 )
2 years ago
0add1fc090
[twitter] improve strategy for user URLs ( #2665 )
...
- use '/with_replies' when appropriate
- consider 'text-tweets'
- build search query as necessary
2 years ago
45c980daf0
[weibo] fix retweets ( #2601 )
2 years ago
34c428abf1
support cygwin/BSD/etc for --cookies-from-browser
...
https://github.com/yt-dlp/yt-dlp/pull/3975
2 years ago
ae1b24aa6a
[instagram] automatically invalidate expired login sessions
2 years ago
42525cfe8d
fix '{…!j}' for otherwise non-serializable types (##2624)
...
like 'datetime'
2 years ago
47a92c8c7e
[instagram] provide 'date' for 'carousel_media' files ( #2660 )
2 years ago
2064f20e11
[instagram} fix 'tag' extractor ( #2659 )
2 years ago
6c0fa2f258
[readcomiconline] update
2 years ago
61cbf8318c
[weibo] fix URLs generated by 'user' extractor ( #2601 )
2 years ago
c2d117163f
release version 1.22.1
2 years ago
4b78bd423f
[paheal] add 'metadata' option ( #2641 )
2 years ago
535cbcb185
cache extracted browser cookies
...
(in memory, for as long as gallery-dl is running)
Extracting encrypted cookies from a chromium-based browser can take a
long time, so repeating this process for each extractor should be
avoided.
Same goes for creating a temporary copy of the entire cookie database.
2 years ago
541a61d344
[subscribestar] fix 'date' metadata ( #2642 )
...
Handle instances where the actual datetime information
is preceded by "Updated on "
2 years ago
46d171c938
[instagram] fix stories ( #2644 )
...
fixing the fix ...
2 years ago
e59bcb8437
[weibo] ensure media URLs use https://
2 years ago
73f673e3ca
[weibo] handle 'gif' pictures
2 years ago
345199a3ec
[pixiv] include '.gif' in background fallback URLs ( #2495 )
2 years ago
57508d3bb7
[weibo] support all different 'tabtype' listings ( #686 , #2601 )
2 years ago
Mike Fährmann