0bd7607da5
[tumblrgallery] improve 'id' extraction ( #2115 )
3 years ago
ac80474371
handle UNC paths ( #2113 )
3 years ago
47df50a2ad
add --sleep-request and --sleep-extractor command-line options
3 years ago
64cf26eaf4
allow specifying sleep-* options as string
...
either as single value or as range: "3.5", "2.1 - 5.0"
3 years ago
0d02a7861e
[tumblrgallery] fix extraction ( closes #2112 )
3 years ago
62692c6842
[exhentai] add 'source' option
...
setting it to "hitomi" downloads the corresponding gallery from
hitomi.la; might be extended to other sources in the future
3 years ago
099ed72de7
[hitomi] disable extra 'metadata' by default
...
safes one HTTP request that not needed with default filename settings
3 years ago
9a25534490
use Extractor._check_cookies() for all cookie checks
3 years ago
63c6bc26b5
[rule34us] extract tags per category ( #1527 )
...
like for other boorus with 'tags': true
3 years ago
f587458a3c
[twitter] include '4096x4096' as a default image fallback
...
(closes #2107 , closes #1881 )
3 years ago
8ed282f7f2
[kemonoparty] support coomer.party URLs ( #2100 )
3 years ago
87ce3fa669
[furaffinity] warn when no session cookies were found
3 years ago
159631c808
[philomena] use a default 'filter_id' if non is given
3 years ago
ad30653b17
allow running a BaseExtractor for any URL
...
by prefixing it with '<base-category>:'
For example:
shopify:https://partakefoods.com/products/crunchy-cookie-variety-pack
gelbooru_v01:https://5naf.booru.org/index.php?page=post&s=view&id=46963
Available base categories are:
mastodon, shopify, moebooru, gelbooru_v01, gelbooru_v02,
reactor, foolslide, foolfuuka, philomena
3 years ago
299bd2f1f5
[rule34us] add 'tag' and 'post' extractors ( #1527 )
3 years ago
3cf1075d86
[inkbunny] add 'search' extractor ( closes #2094 )
3 years ago
c6a23c26d7
[instagram] allow downloading specific stories ( closes #2088 )
...
https://instagram.com/stories/ <USER>/<ID> now only downloads the one
story specified by <ID> and not all stories from that user.
3 years ago
352ffcddb0
[instagran] match post URLs with usernames ( fixes #2085 )
3 years ago
45ca1693d8
add indicator to debug output when using a standalone executable
3 years ago
64978b5d37
build executables with Python 3.9 ( #1922 )
...
and also build a x86 Python 3.8 version for Windows 7 compatibility
3 years ago
f4e3cee6ac
use yt-dlp by default ( #1850 , #2028 )
3 years ago
f1b142e993
{kemonoparty[ change default 'files' order to attachments,file,inline
...
(#1991 )
3 years ago
0054ad434e
[output] write directly to sys.stdout
3 years ago
da14b3fe9f
[output] write download progress indicator to stderr
3 years ago
604d5b8bb2
release version 1.19.3
3 years ago
275543b2d2
update extractor test results
3 years ago
e7ea4f2567
[mangoxo] fix metadata extraction
3 years ago
1efef60350
Add py3.10 to tested python versions ( #2056 )
3 years ago
e298882acc
[kemonoparty] match URLs with www subdomain
3 years ago
addb72e1bb
[reactor] support thatpervert.com ( closes #2029 )
3 years ago
d8d9502e1e
[reactor] inherit from BaseExtractor
3 years ago
f4ea216c95
[shopify] support loungeunderwear.com ( closes #2053 )
3 years ago
93cef78450
[gelbooru] workaround pagination limits
...
Gelbooru only allows to retrieve the latest 20k posts for a tag search.
Add 'id:<N' to the search tags to work around that limitation, where N
is the ID of the last retrieved post.
http://gelbooru.me/index.php?page=forum&s=view&id=1467
3 years ago
f2ae179713
[exhentai] fix extraction for disowned galleries ( closes #2055 )
3 years ago
612850438e
[skeb] add 'thumbnails' option ( #2047 ) ( #2051 )
3 years ago
010d65dcec
extend blacklist/whitelist syntax ( #2025 )
...
Each entry in such a list can now also include a subcategory
'<category>:<subcategory>'
and it is possible to use '*' or an empty string as placeholder
'*:<subcategory>', ':<subcategory>', '<category>:*'
For example
"blacklist": "imgur,*:tag,gfycat:user" or
"blacklist": ["imgur", "*:tag", "gfycat:user"]
will filter all 'imgur' extractors, all extractors with a 'tag'
subcategory (e.g. https://danbooru.donmai.us/posts?tags=bonocho ),
and all 'gfycat' user extractors.
3 years ago
11a3d96d13
[mangadex] load additional metadata using includes[] directives
...
- always provide 'artist', 'author', and 'group' metadata fields (#2049 )
- remove 'metadata' option
3 years ago
19e00f1322
[dynastyscans] provide 'date' as proper datetime object ( #2050 )
3 years ago
af6424f398
allow testing metadata in list elements
3 years ago
c67756e187
[kemonoparty] add 'dms' option ( #2008 )
3 years ago
3842cdcd8f
[formatter] implement 'D' format specifier
...
To be able to parse any string into a 'datetime' object
and format it as necessary.
Example:
{created_at:D%Y-%m-%dT%H:%M:%S%z}
->
"2010-01-01 00:00:00"
{created_at:D%Y-%m-%dT%H:%M:%S%z/%b %d %Y %I:%M %p}
->
"Jan 01 2010 12:00 AM"
with 'created_at' == "2010-01-01T01:00:00+0100"
3 years ago
3a7a19c7b9
[dynastyscans] add 'manga' extractor ( closes #2035 )
3 years ago
9bc83af3a6
[kemonoparty] 'postfile' -> 'file' ( #1991 )
...
to stay consistent with the existing file types for kemono
3 years ago
522782c09d
[subscribestar] emit metadata for posts without media ( #1569 )
3 years ago
1c8aaf9318
[subscribestar] add 'num' enumeration index ( closes #2040 )
3 years ago
d433735750
[kemonoparty] skip duplicate files ( #2032 , #1991 , #1899 )
...
Extract the SHA-256 file hash from URLs
and skip files with the same hash in the same post.
- provide a 'hash' metadata field (empty string if not available)
- remove 'patreon-skip-file' option
3 years ago
d4ec245554
[kemonoparty] implement a 'files' option ( #1991 )
...
similar to 8d676151
3 years ago
ab8eea1a24
[twitter] fix extractor for direct image links ( fixes #2030 )
3 years ago
2076d40681
[ytdl] improve error handling ( #1680 )
3 years ago
8eaedb0bd3
[ytdl] fix some compatibility issues ( #1680 )
3 years ago
Mike Fährmann