67a2efb885
[rule34] implement 'pool' pagination ( #2853 )
2 years ago
70dc4ce911
[skeb] ignore article images with empty URL
...
8cf5981ded (commitcomment-81980633)
2 years ago
f362d4a3c7
[e621] fix 'popular' extraction
2 years ago
7e385ed63e
[foolfuuka] update domains
...
- remove nyafuu
- add rozenarcana (https://archive.alice.al/ )
- add tokyochronos (https://www.tokyochronos.net )
2 years ago
6ba72b6bc6
[twitter] ignore invalid user entries ( #2850 )
2 years ago
e4cff67aaa
[tumblr] add count metadata field ( #2804 )
...
Fixes #2778
2 years ago
574e38a287
[kemonoparty] add 'favorites' option ( #2826 ) ( #2831 )
...
* [kemonoparty] add 'favorites' option (#2826 )
* [kemonoparty] add regex for the url parameter and fallback on the config
option
* [kemonoparty] simplify
2 years ago
a799fae2df
[catbox] add 'album' extractor ( #2410 )
...
adapted from https://github.com/mikf/gallery-dl/pull/2805
- rewrite using GalleryExtractor
- extract more metadata
- match lolisafe names
- add test
2 years ago
264f1336ad
[twitter] unescape '+' in search queries ( #2226 )
...
... and do not raise exception if searched user does not exist
2 years ago
21ff77fea0
[zerochan] extract more metadata for single posts
...
Neither HTML pages nor RSS feed entries have *all* metadata.
It might be necessary to do 1-2 extra HTTP requests to grab everything.
2 years ago
391aecf219
[instagram] provide 'date' for directories ( #2830 )
2 years ago
9ea521bec5
[oauth] add host config option ( #2806 )
2 years ago
9ad3cdc5d8
[twitter] use '{author[name]' in default directory names
...
with the changes to 'user' (749802c7
2 years ago
1c89ccb27d
[weibo] prevent errors when paginating over album entries ( #2817 )
2 years ago
a27b17481f
[tumblr] restrict condition for calling _original_image
2 years ago
df1c643dda
[tumblr] attempt to extract full-resolution photos
...
- for photos with apparent width == 2048 or height == 3072
- can be disabled with 'original' option
2 years ago
a69f198ac9
[wallhaven] implement 'metadata' option ( #2803 )
2 years ago
033faf67ec
[poipiku] update filter for static images ( #2796 )
2 years ago
b9a14b5758
[poipiku] fix posts with more than one image ( #2796 )
2 years ago
0f5826e884
[weibo] prevent exception for missing 'playback_list' ( #2792 )
2 years ago
81a37d21d3
[twitter] simplify 'user' assignment
2 years ago
8a70b94245
[twitter] implement constant 'user' for tweet URLs
2 years ago
8cf5981ded
[skeb] add option to download 'article' images ( #1031 )
2 years ago
43ec315a7f
[deviantart] use public access token for journals ( #2702 )
...
and retry with a private token if needed
2 years ago
3f08a91131
[bunkr] fix extraction ( #2788 )
...
... again
2 years ago
5038893cdd
[blogger] emit metadata for posts without files ( #2789 )
2 years ago
98af5a0409
[zerochan] implement login with username & password ( #1434 )
2 years ago
3a8addfe45
[zerochan] add 'tag' and 'image' extractors ( #1434 )
2 years ago
e660e48a60
[vk] prevent exceptions for broken/invalid photos ( #2774 )
2 years ago
f559943d77
[instagram] fix empty 'params' in '_pagination_api()'
2 years ago
1540d0e695
[twitter] use filter:links ( #2766 )
2 years ago
8d0801ad8e
[twitter] fall back to unfiltered search ( #2766 )
2 years ago
0aa8345a13
[mastodon] allow downloading without access token ( #2782 )
...
Most mastodon instances allow accessing /api/v1/accounts/XXXX/statuses and api/v1/statuses/XXXX without an API access token.
This commit allows users to download at least some links from such a mastodon instance that does not already have access tokens hard-coded into the extractor.
User extractor only works on links that include the user id such as https://mastodon.tld/@id:12345 . Status links work as-is.
2 years ago
ea5ffb19a6
fanbox: download cover images in original size ( #2784 )
2 years ago
977d53b640
[Instagram] Add support for user's saved collection ( #2769 )
...
* [Instagram] Add support for user's saved collection
* [Instagram] Run formatter
* [Instagram] Simplify collection_id retrieval and add metadata
* [Instagram] Fix bug when params is not passed to _pagination_api
2 years ago
5b63df46c0
[tumblr] attempt to get higher-quality images ( #2761 )
2 years ago
59b16b3f70
[artstation] add 'num' and 'count' metadata fields ( #2764 )
2 years ago
eb68d45544
add global 'warnings' option ( #2762 )
2 years ago
f225247670
[gelbooru] add support for `api_key` and `user_id` ( #2767 )
2 years ago
77bdd8fe0f
[twitter] implement constant 'user' for 'from:…' searches
2 years ago
a267a05a3f
[twitter] update 'quote_id' and 'quote_by'
...
- 'quote_id' is now non-null for quoted Tweets and has the ID of the
quoting Tweet, instead the other way round like before
- 'quote_by' is now the 'screen_name' of the quoting user
(was the same the new 'quote_id' is now)
2 years ago
749802c7bd
[twitter] update 'user' and 'author' fields
...
- 'author' is always the user who authored a tweet
- 'user' is always the user specified in the input URL
or equal to 'author' when the former is not given
2 years ago
a566e63cdf
[tumblr] support '/blog/view' URLs ( #2760 )
2 years ago
46f11a3118
[bunkr] fix extraction ( #2732 )
...
move bunkr.is code to its own module
2 years ago
baf3815ebd
[nozomi] small code optimizations
2 years ago
836402bf58
[twitter] unescape content ( #2756 ) ( #2757 )
...
Fixes #2756
2 years ago
62cc47755b
[nozomi] reduce memory consumption during searches ( #2754 )
...
only load and use the entire 'index.nozomi' database
if there are only negative search terms
2 years ago
467a2a4d35
[instagram] add 'pinned' metadata field ( #2752 )
...
'pinned' is a list of user IDs for which a post is pinned
and empty if not pinned anywhere.
2 years ago
fe2b3d57d4
[komikcast] update domain
2 years ago
4e11ca737e
[hentaifoundry] fix metadata extraction
2 years ago
Mike Fährmann