976ccb267f
[myportfolio] combine gallery and user extractors
...
An URL alone isn't good enough to distinguish between a gallery or a
gallery-listing, so the new extractor decides what to do based on the
page's content.
6 years ago
9c0e2f294b
[shopify] add generic collection and product extractors ( #175 )
...
with fashionnova.com as a default domain
6 years ago
13e0f2a78f
[deviantart] add 'scraps' extractor ( closes #168 )
6 years ago
280531c8ff
[pururin] add gallery extractor ( closes #174 )
6 years ago
3159dd79d5
[seiga] use HTTPS
6 years ago
ea6fbfdd39
simplify build_supportedsites.py
6 years ago
22d3a2fcc8
[artstation] add extractor for artwork listings ( #80 )
...
like https://www.artstation.com/artwork?sorting=latest
or https://www.artstation.com/artwork?sorting=picks
6 years ago
937a802b49
[dynastyscans] add extractors for images and image searches
...
(closes #163 )
6 years ago
19860655a3
[weibo] add 'user' and 'status' extractors
6 years ago
ae353ed3b0
provide "extractor" and "job" keys for logging output
...
This allows for stuff like "{extractor.url}" and "{extractor.category}"
in logging format strings.
Accessing 'extractor' and 'job' in any way will return "None" if those
fields aren't defined, i.e. in general logging messages.
6 years ago
53c2fd4664
add mastodon/foolslide/foolfuuka examples to example config
6 years ago
d36ec51e5a
[tsumino] add extractor for search results ( #161 )
6 years ago
bfbbac4495
[tsumino] add login capabilities ( #161 )
6 years ago
6126615698
update URLs for supportedsites.rst
6 years ago
80a75a1ecf
[tsumino] add gallery extractor ( #161 )
6 years ago
0c32dc5858
[hentaifox] add extractor for search results ( #160 )
6 years ago
0156189468
[hentaifox] add chapter extractor ( #160 )
6 years ago
e4171d6baf
[luscious] add login capabilities ( closes #159 )
6 years ago
134487ffb0
[exhentai] stop extraction if image limit is exceeded ( #141 )
...
can be turned off with the `exhentai.limits' option
6 years ago
b50b30f1c9
[photobucket] download subalbums ( #117 )
6 years ago
277b52101a
add 'category-transfer' option
...
[ci skip]
6 years ago
4b441c162e
release version 1.6.3
6 years ago
8aba2bdebf
[postprocessor:metadata] add 'tags' and 'custom' modes ( #135 )
6 years ago
e53cdfd6a8
update build_supportedsites.py
6 years ago
1e4d351ad3
[danbooru] add authentication support ( closes #151 )
...
... via HTTP Basic Auth with username and "password".
The password value in this case is not the account password itself,
but the"api_key" found in your user profile.
6 years ago
06cbf5f9c4
implement 'chapter-reverse' option ( #149 )
...
Setting it to `true` will start with the latest chapter instead of the
first one.
6 years ago
e95b24f056
[reactor] add wait-min & -max options ( #148 )
6 years ago
a36f52a730
[joyreactor] add extractor for search results ( #148 )
6 years ago
6c71e9cf5d
[deviantart] add separate 'sta.sh' extractor ( #113 )
...
- supports multiple stashed deviations per page
- explicitly mentions sta.sh support on supportedsites.rst
6 years ago
28f9539551
[tumblr] change default values for post types and inline media
6 years ago
5be95034ba
[tumblr] add option to download avatars ( #137 )
6 years ago
be52069cbc
update CHANGELOG and docs/supportedsites
6 years ago
c47482b110
smaller changes, missing docs, etc.
...
- make 'netrc' extractor-specific
- rename 'downloader.enable' to 'enabled'
- document 'downloader.ytdl.format'
- consistent newlines in configuration.rst
6 years ago
8ef84a6823
add option to enable/disable specific downloader modules
...
... and write URLs with no (active) downloader to unsupported-file
6 years ago
2fa28a2609
update default user-agent string ( closes #122 )
6 years ago
655549df7c
[downloader:ytdl] add several options
...
The "default" downloader options (rate, retries, timeout, verify) are
mapped to corresponding youtube-dl options.
downloader.ytdl.logging tells the downloader to pass youtube-dl's output
to a Logger object.
downloader.ytdl.raw-options allows to pass arbitrary options to the
YoutubeDL constructor.
6 years ago
6ed629f2b6
allow specifying number of skips before abort/exit ( closes #115 )
...
In addition to 'abort' and 'exit', it is now possible to specify
'abort:N' and 'exit:N' (where N is any integer) as value for 'skip'
to abort/exit after consecutively skipping N downloads.
6 years ago
d8492df51b
[deviantart] extend functionality of 'original' option
6 years ago
392a081657
update 'docs/configuration.rst'
6 years ago
f8b3b00249
[twitter] add experimental 'videos' option ( #99 )
...
Enabling this option will detect videos in tweets and output them as
"unsupported" URLs, so that these can then be downloaded with youtube-dl
There are a lot of improvements to be made to the current
implementation, but it works and does what it is supposed to, even if
inefficient as can be ...
6 years ago
2cf3f53839
[yuki] add thread extractor ( closes #111 )
6 years ago
17611bfec0
update build_supportedsites.py script
6 years ago
09d2f3e5e7
[postprocessor:ugoira] improve libx264 detection
6 years ago
c402cc4047
[hentaifoundry] add 'popular' and 'recent' extractors
...
for "Popular Pictures" and "Recent Pictures" listings
6 years ago
a5fc311dfa
[hentaifoundry] add 'favorite' extractor
6 years ago
55f5c87160
[postprocessor:ugoira] add 'libx264-prevent-odd' option
...
A rather crude workaround for "width/height not divisible by 2"
errors when using libx264.
6 years ago
006f75b538
[hentaifoundry] rewrite + more metadata
...
- extract width, height, artist per image
- improve pattern regex
- better extensibility for other listings
6 years ago
6ea9a78588
[wallhaven] add login capabilities
...
Being logged in is required to access NSFW wallpapers.
6 years ago
c9290d8212
[wallhaven] add wallpaper and search extractors
...
todo:
- login support to gain access to NSFW wallpapers
- extractors for tag-, similar-, latest-listings
- skip() support
6 years ago
22ab509a70
[bobx] rename "model" to "idol" extractor
6 years ago
Mike Fährmann