459a0af4f8
[sankaku] add support for sankaku.app URLs ( closes #1193 )
4 years ago
371e9ca6df
[pinterest] implement video support ( closes #1189 )
4 years ago
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
4 years ago
212ae0c399
[mangapanda] remove module
...
site now redirects to mangareader.net
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
cc15fbe71a
[moebooru] add generalized extractors for moebooru sites
...
- add support for sakugabooru.com (closes #1136 )
- add support for lolibooru.moe (closes #1050 )
This allows users to dynamically add support for moebooru/myimouto
based sites by adding an entry to their config file
(like for foolslide, foolfuuka, etc)
For example:
{
"extractor": {
"moebooru": {
"new-site-1": {"root": "https://site1.net "},
"new-site-2": {"root": "https://www.site2.moe "}
}
}
}
4 years ago
0bc492c0fa
add docs for 'event' and 'filename' options
...
from 9c3568c3ca59bd69
4 years ago
9b1bd09454
change 'extension-map' default
...
Replace all JPEG filename extensions with 'jpg'.
4 years ago
de0c57886d
[twitter] add 'list-members' extractor ( closes #1096 )
4 years ago
bc7b1d91bc
fix rST markup in configuration.rst
...
[ci skip]
4 years ago
e3480bc8de
implement 'extension-map' option ( #318 )
4 years ago
98a4d86a01
[sankakucomplex] extract videos and embeds ( closes #308 )
4 years ago
d83b95fd28
[postprocessor:metadata] accept a string-list for 'content-format'
...
(closes #1080 )
4 years ago
5bcf28de93
add a 'extractor.modules' option
4 years ago
18213dc5ba
release version 1.15.2
4 years ago
1686dc1757
[twitter] support media from Cards ( #1005 , #937 )
...
Can be enabled with 'extractor.twitter.cards', but for now disabled by
default because cards can redirect to rather large videos from YouTube
or Twitch.
4 years ago
bac8af69e8
update configuration.rst
...
- add some lines to better explain post processor usage
- syntax highlighting for JSON blocks and other smaller stuff
4 years ago
05d7009cc6
rename 'Authentication' entries in supportedsites.rst
...
- change 'Optional' to 'Supported'
- use 'OAuth' and 'Cookies' in their own
- add link to weasyl API key option
4 years ago
d1c6d78477
fix rST markup in configuration.rst
4 years ago
b8daabc3ca
[pinterest] implement login support ( closes #1055 )
...
being logged allows access to secret/protected boards
4 years ago
3ec60e894a
[weasyl] api-key authentication ( #1057 )
...
* [weasyl] support api keys
* [weasyl] document api-key authentication
* [weasyl] usernames can contain ~
4 years ago
35056a07d1
release version 1.15.1
4 years ago
dd1e545597
[hentaifoundry] rename GalleryExtractor to PicturesExtractor
4 years ago
c874071f5a
[kissmanga] remove module
4 years ago
430b6d6e2e
[twitter] extend 'retweets' option ( closes #1026 )
...
Setting 'retweets' to '"original"' will use metadata from the
original retweeted Tweets, and not from the Retweet entry.
4 years ago
b9bdd2c564
[hentaifoundry] add support for stories ( closes #734 )
4 years ago
117582d798
use definition lists instead of tables in docs/configuration.rst
...
and strip some clutter from generated man pages
4 years ago
cc4ac80302
[weasyl] add 'favorite' extractor ( #1032 )
4 years ago
e9cc719497
[weasyl] update and simplify
...
- simplify 'pattern' regexps
- parse 'posted_at' as 'date'
- use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)
4 years ago
6514312126
[nijie] add 'include' option ( closes #1018 )
4 years ago
0d43456323
[hentaifoundry] add 'include' option
4 years ago
ebb7737b9b
Weasyl Extractor ( #977 )
...
* weasyl extractor
* @kattjevfel suggested changes
* @mikf changes
4 years ago
1e313d5b84
implement 'sleep-request' option
4 years ago
c43b3894be
[myhentaigallery] update and fix extraction ( #1001 )
...
- extract more metadata
- match "/show/" URLs
- complete test results
- fix missing images for lines starting with " <img"
- fix missing comma in supportedsites.py
4 years ago
6a5f6396d4
add clearing cache to dA client-id instructions ( #996 )
4 years ago
3afd362e2e
add 'sleep-extractor' option ( closes #964 )
...
(would have been nice if this were possible without code duplication)
4 years ago
3108e85b89
[worldthree] remove extractors
...
http://www.slide.world-three.org/ hasn't been accessible for a long time.
4 years ago
8fed3eb8cb
[jaiminisbox] remove extractors
...
https://jaiminisbox.com/post.html
4 years ago
3918b69677
remove 'extractor.blacklist' context manager
4 years ago
c78aa17506
add general 'blacklist' and 'whitelist' options ( #492 , #844 )
4 years ago
5912727b88
support format string replacement fields in archive paths
...
(closes #985 )
4 years ago
f6fd449b59
reduce wait time growth rate from exponential to linear
...
Waiting for 2**N seconds after each error grows too fast.
Simply waiting N seconds seems far more reasonable.
4 years ago
ac3036ef56
add 'filesize-min' and 'filesize-max' options ( closes #780 )
4 years ago
e33293fdd8
[hentaihand] update to new site layout
4 years ago
ab1af66a97
[imgur] add 'search' extractor ( #934 )
4 years ago
0e941553ec
[aryion] Add username/password support ( #960 )
...
* Add username/password support to aryion extractor
* Update docs to match
* Fix code style
4 years ago
063c71cd84
[furaffinity] add 'search' extractor ( closes #915 )
4 years ago
dbbbb21180
[exhentai] add ability to specify custom image limit ( #940 )
4 years ago
2b88c90f6f
[blogger] add search extractor ( #925 )
4 years ago
Mike Fährmann