cf5fa75d4c
add 'browser' option ( #1117 )
...
- change default user agent to Firefox ESR 78 on Windows 10
- remove 'ciphers' option
4 years ago
e5735361ed
[exhentai] add 'metadata' option ( #1325 )
...
to select between gallery metadata from 'api' or 'html'
4 years ago
5ad2b9c82b
[deviantart] extend 'extra' option
...
also download from embedded DeviantArt posts
4 years ago
560277394e
[downloader:http] add 'headers' option ( #1322 )
4 years ago
6b0ecbf6bc
[hentainexus] add 'orignal' option ( #1322 )
4 years ago
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
4 years ago
cdb0b02e30
[pillowfort] add 'reblogs' option ( #846 )
4 years ago
7a096c443f
[unsplash] add 'format' option ( #1197 )
4 years ago
89a2bcbb2d
[furaffinity] add 'descriptions' option ( #1231 )
4 years ago
36f281330a
[newgrounds] fix flash file extraction ( closes #1257 )
...
… and add a 'flash' option to choose between flash and video formats.
4 years ago
c008cb5100
[pixiv] add 'related' option ( #1237 )
4 years ago
01b9ccd4de
[derpibooru] use the "Everything" filter by default ( #1243 )
...
when neither 'api-key' nor 'filter' are set
4 years ago
5d4494b15f
add "ascii" as a special 'path-restrict' value
4 years ago
fa8ee6eac4
[derpibooru] add search and gallery extractors ( #862 )
4 years ago
371e9ca6df
[pinterest] implement video support ( closes #1189 )
4 years ago
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
0bc492c0fa
add docs for 'event' and 'filename' options
...
from 9c3568c3ca59bd69
4 years ago
9b1bd09454
change 'extension-map' default
...
Replace all JPEG filename extensions with 'jpg'.
4 years ago
bc7b1d91bc
fix rST markup in configuration.rst
...
[ci skip]
4 years ago
e3480bc8de
implement 'extension-map' option ( #318 )
4 years ago
98a4d86a01
[sankakucomplex] extract videos and embeds ( closes #308 )
4 years ago
d83b95fd28
[postprocessor:metadata] accept a string-list for 'content-format'
...
(closes #1080 )
4 years ago
5bcf28de93
add a 'extractor.modules' option
4 years ago
1686dc1757
[twitter] support media from Cards ( #1005 , #937 )
...
Can be enabled with 'extractor.twitter.cards', but for now disabled by
default because cards can redirect to rather large videos from YouTube
or Twitch.
4 years ago
bac8af69e8
update configuration.rst
...
- add some lines to better explain post processor usage
- syntax highlighting for JSON blocks and other smaller stuff
4 years ago
05d7009cc6
rename 'Authentication' entries in supportedsites.rst
...
- change 'Optional' to 'Supported'
- use 'OAuth' and 'Cookies' in their own
- add link to weasyl API key option
4 years ago
d1c6d78477
fix rST markup in configuration.rst
4 years ago
b8daabc3ca
[pinterest] implement login support ( closes #1055 )
...
being logged allows access to secret/protected boards
4 years ago
3ec60e894a
[weasyl] api-key authentication ( #1057 )
...
* [weasyl] support api keys
* [weasyl] document api-key authentication
* [weasyl] usernames can contain ~
4 years ago
35056a07d1
release version 1.15.1
4 years ago
c874071f5a
[kissmanga] remove module
4 years ago
430b6d6e2e
[twitter] extend 'retweets' option ( closes #1026 )
...
Setting 'retweets' to '"original"' will use metadata from the
original retweeted Tweets, and not from the Retweet entry.
4 years ago
b9bdd2c564
[hentaifoundry] add support for stories ( closes #734 )
4 years ago
117582d798
use definition lists instead of tables in docs/configuration.rst
...
and strip some clutter from generated man pages
4 years ago
6514312126
[nijie] add 'include' option ( closes #1018 )
4 years ago
0d43456323
[hentaifoundry] add 'include' option
4 years ago
1e313d5b84
implement 'sleep-request' option
4 years ago
6a5f6396d4
add clearing cache to dA client-id instructions ( #996 )
4 years ago
3afd362e2e
add 'sleep-extractor' option ( closes #964 )
...
(would have been nice if this were possible without code duplication)
4 years ago
3918b69677
remove 'extractor.blacklist' context manager
4 years ago
c78aa17506
add general 'blacklist' and 'whitelist' options ( #492 , #844 )
4 years ago
5912727b88
support format string replacement fields in archive paths
...
(closes #985 )
4 years ago
f6fd449b59
reduce wait time growth rate from exponential to linear
...
Waiting for 2**N seconds after each error grows too fast.
Simply waiting N seconds seems far more reasonable.
4 years ago
ac3036ef56
add 'filesize-min' and 'filesize-max' options ( closes #780 )
4 years ago
0e941553ec
[aryion] Add username/password support ( #960 )
...
* Add username/password support to aryion extractor
* Update docs to match
* Fix code style
4 years ago
dbbbb21180
[exhentai] add ability to specify custom image limit ( #940 )
4 years ago
901a897e6f
[inkbunny] mention login support
4 years ago
b921fee24d
[inkbunny] fix submission order ( #283 )
...
Getting detailed submission info via /api_submissions.php reordered the
input submissions and sorted them by ID. InkbunnyAPI.detail() now sorts
them back and ensures they are returned in their original order.
This commit also removes the 'metadata' option and always requests
submission descriptions.
4 years ago
c4ed9f4faa
[inkbunny] add 'metadata' option ( #283 )
4 years ago
493cadb1e7
[inkbunny] add 'orderby' option ( #283 )
4 years ago
d5fcffcced
[subscribestar] add login capabilities ( #852 )
4 years ago
ecaecc4064
[exhentai] add 'domain' option ( #897 )
4 years ago
cb0132e441
[khinsider] add 'format' option ( closes #840 )
4 years ago
f1ddbff0b5
[aryion] add 'recursive' option ( fixes #832 )
...
This is enabled by default and will recursively go through all
(sub)folders in an artist's gallery.
The old method of using "Latest Updates" lists can be restored by
disabling this option.
4 years ago
9da2bc67f8
[twitter] add option to filter media from quoted tweets ( #854 )
4 years ago
5ba90f72ca
[pinterest] add support for sections ( closes #835 )
4 years ago
c184cce876
update configuration.rst
...
- fix anonymous links
- update description of 'extractor.twitter.videos'
- document 'extractor.redgifs.format' (#724 )
4 years ago
41d03160ff
[deviantart] also search journals for sta.sh links ( #712 )
...
when 'extra' is enabled
4 years ago
0138e9c1d8
[twitter] remove 'content' option
...
The text content of each tweet is always available as 'full_text'
4 years ago
0f459f340b
[instagram] fix and re-enable login with username&password
...
This reverts commit 3e0848a482#756 , #771 , #797 , #803 )
https://github.com/althonos/InsaLooter/issues/287#issuecomment-630456522
4 years ago
3e0848a482
[instagram] disable login with username&password ( #756 )
4 years ago
da22ea8ced
use %APPDATA%\gallery-dl for config/cache on Windows
4 years ago
b489f4de12
fix internal links in configuration.rst
4 years ago
dfcf2a2c91
write OAuth token to cache by default ( #616 )
4 years ago
ddc253cf9a
implement a 'path-replace' option ( #662 , #755 )
4 years ago
bc53302ad6
extend 'path-restrict' option
...
Allow its value to be a JSON object / Python dict that specifies
a mapping from invalid/unwanted input characters to specific
output characters.
For example {"/": "-", "*": "+"} will transform
"foo / ***bar***" into "foo - +++bar+++"
(closes #662 , #755 )
4 years ago
e19f665a44
[danbooru] change default for 'ugoira' to 'false'
...
Downloading the pre-rendered versions should be a better default
than .zip files with individual frames.
4 years ago
dba87ca99e
[downloader:ytdl] change 'forward-cookies' default to 'false'
...
There are currently no situations where forwarding gallery-dl's cookies
to youtube-dl is necessary, and it only causes problems when forcing
youtube-dl for Twitter video downloads while logged in.
4 years ago
be16d77073
simplify and improve documentation markup ( #742 )
...
- use | to get a more "compact" representation
- link directly to example config files
4 years ago
fe224416bf
Some documentation improvements ( #742 )
...
* Link configuration examples in the intro, see #712
* Clarify overriding conf files by options, see #678
4 years ago
5e2974d699
[weibo] add 'videos' option
4 years ago
9f638c2e01
[twitter] add 'replies' option ( closes #705 )
4 years ago
5b676ea59d
[e621] document username & password support ( #640 )
5 years ago
59edcdc822
[hitomi] restore metadata fields from before f33b13a
...
... and add a 'metadata' option to disable
visiting the gallery page and extracting data from it
if this is not needed.
5 years ago
a45fbc38ea
[pixiv] implement 'avatar' option ( #595 , #623 )
5 years ago
6e759fe2f5
reword note for 'extractor.deviantart.refresh-token' ( #612 )
5 years ago
67ea80222c
link to post processor example in 'pixiv.ugoira' docs
5 years ago
74e684e828
[twitter] change default value for 'videos' to 'true'
...
Every other 'videos' option defaulted to 'true', except Twitter.
5 years ago
ab13f81fd7
add example to 'cookies' docs
5 years ago
c7cf9dd111
[furaffinity] support classic layout ( #284 )
5 years ago
da0d5f6092
[oauth] add 'port' option ( #604 )
5 years ago
091f9a107d
[docs] add examples of how to filter manga chapters by language
...
(closes #599 )
5 years ago
dff33b260c
[reddit] add 'videos' option
5 years ago
56f1c96168
implement 'parent-directory' option ( #551 )
5 years ago
6703b8a86b
[blogger] implement video extraction ( closes #587 )
5 years ago
37247dbaff
miscellaneous fixes
5 years ago
25d5ec4ff3
[twitter] add option to extract TwitPic embeds ( #579 )
5 years ago
254f7c3999
implement a post-processor module to compare file versions
...
(#530 )
5 years ago
87c8b89ddd
[postprocessor:metadata] add 'directory' option ( #520 )
5 years ago
48e42e73fb
[reddit] change default value for 'comments' to '0'
5 years ago
bf658fd84b
[vsco] implement 'videos' option
5 years ago
95c90722ee
[instagram] implement 'videos' option ( closes #521 )
5 years ago
15f9bb3d14
add option to disable pyOpenSSL usage ( #508 )
...
(pyOpenSSL is now disabled by default)
5 years ago
93b43f74f4
update docs/configuration.rst
...
- fix description of "skip": "enumerate"
- use line breaks for lists of multiple examples
- improve formatting of auto-generated man pages
5 years ago
e17907ee2a
change default value of 'cookies-update' to 'true'
5 years ago
26d2334550
[postprocessor:metadata] rename 'format' to 'content-format'
...
Just to be consistent with the other 'extension-format' option name,
and only 'format' is also still accepted.
5 years ago
a412531451
[postprocessor:metadata] implement 'extension-format' option
...
closes #477
5 years ago
d45fabb79d
match user profile handling on deviantart and newgrounds
5 years ago
Mike Fährmann