b37a62501b
[pixiv] unquote tags
7 years ago
fbd7dcdfdb
[desuarchive] add thread extractor
7 years ago
af9bd17b19
[deviantart] adjust default paths
...
- user.deviantart.com/(gallery|favourites|journal)/ images go into
* <user>/
* <user>/Favourites/
* <user>/Journal/
(having an extra "Gallery" folder for a user's gallery-images seems
a bit too much if these are all you want to download, which is
probably the default use-case)
- single "deviations" (user.deviantart.com/(art|journal)/name-123) go
into their owner's directory:
* <user>/
(putting them into their own directory seems weird in practice)
7 years ago
eb64fb267c
[nyafuu] add thread extractor ( #18 )
7 years ago
726c6f01ae
allow 'cookies' config option to be a dictionary
7 years ago
4877ef6314
[deviantart] support '?catpath=/' URLs ( #26 )
...
They previously weren't supported for galleries and journals.
This also increases the 'limit' parameter for API calls to its
respective maximum.
7 years ago
9edbd6ff01
update configuration.rst
7 years ago
8c16cbe7ea
fix tests
7 years ago
a6f689e01a
[deviantart] add gallery-folder extractor ( #26 )
...
The code for this and the available metadata is probably going
to change again. This extractor is very similar to the favorite-
extractor, so they might be "combined" or something like that.
7 years ago
474e9c1aec
[4plebs] add thread extractor ( #18 )
7 years ago
a804a42e23
add '--cookies' command-line option
7 years ago
dcc1d3b2ea
[hentaifoundry] fix infinite loop for multiple of 25 images
7 years ago
ce55ec6490
enable extractor tests without filters
...
$ python test_extractors.py all
7 years ago
34e6e1099e
[batoto] adapt to https chapter URLs
7 years ago
85696d0b3b
[reddit] fix issue with datetime errors
7 years ago
80c2e03aaa
[reddit] allow 'date-min/max' to be human readable dates
...
If the date-min/max config value is a string, try parsing it using
datetime.strptime [1] with 'date-format' as format string [2]
(default: "%Y-%m-%dT%H:%M:%S")
Example: get all submissions posted in 2016
$ gallery-dl reddit.com/r/... \
-o date-format=%Y \
-o date-min=\"2016\" \
-o date-max=\"2017\"
[1] https://docs.python.org/3/library/datetime.html#datetime.datetime.strptime
[2] https://docs.python.org/3/library/datetime.html#strftime-strptime-behavior
7 years ago
58e95a7487
share extractor and downloader sessions
...
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
7 years ago
4414aefe97
small fix for aes_cbc_decrypt_text
7 years ago
21064146c1
fix test
7 years ago
f3d0373120
[reddit] add ability to filter by submission id
...
'extractor.reddit.id-min' and '….id-max' specify the lowest and
highest submission-/post-id to consider, similar to 'date-min' and
'date-max'
7 years ago
06c4cae05b
extend the output of '--list-extractors'
...
It now includes category and subcategory values for
each extractor class.
7 years ago
1dac76fd1c
update extractor docstrings
7 years ago
b757687606
Update configuration.rst ( #24 )
...
Fixed minor typo.
7 years ago
e217e23e29
release version 0.9.0
7 years ago
92a11528d1
smaller changes
7 years ago
598e3a8d88
update configuration.rst
7 years ago
86561d7c8b
update configuration.rst
7 years ago
44d98e562b
[pixiv] support pixiv.me URLs ( #23 )
7 years ago
b373fe0eea
[pixiv] support shortened URLs and other variants ( #23 )
7 years ago
c951d6276c
[imagetwist] use https
7 years ago
d3b04076f7
add .netrc support ( #22 )
...
Use the '--netrc' cmdline option or set the 'netrc' config option
to 'true' to enable the use of .netrc authentication data.
The 'machine' names for the .netrc info are the lowercase extractor
names (or categories): batoto, exhentai, nijie, pixiv, seiga.
7 years ago
fbe8c519e2
update README
...
- mention and link to docs/configuration.rst
- add OAuth section
7 years ago
e1d82af5e0
small fixes
7 years ago
ccb7973b57
update configuration.rst
7 years ago
719d45f89e
[flickr] allow the use of Flickr's specifiers for format selection
...
- renamed the 'width-max' option to 'size-max'
- filter by both width and height
7 years ago
b4c438c9ad
[oauth] add the 'extractor.oauth.browser' option
...
enables/disables the use of webbrowser.open() during OAuth authorization
7 years ago
1a9b4759a2
Merge pull request #21 from Hrxn/patch-1
...
Update configuration.rst
7 years ago
b206b831ee
Update configuration.rst
...
Fix heading.
7 years ago
2633337833
[kissmanga] update regex ( fixes #20 )
7 years ago
fac6c02224
[downloader] fix extension from content-type
7 years ago
e68af4febe
[flickr] add 'width-max' option ( #16 )
...
This option allows for simple format selection by
specifying a maximum image width.
7 years ago
48b444e276
add a list of all configuration options
...
(the format might be subject to change; putting everything in
one single table is even worse)
7 years ago
2993206c4b
smaller fixes and "security" measures
...
- move the OAuthSession class into util.py
- block special extractors for reddit and recursive
- ignore 'only matching' tests for testresults script
7 years ago
fb1904dd59
add 'Authentication' column to supportedsites.rst
7 years ago
8d5e92f641
resolve cyclic dependency between oauth and flickr
7 years ago
d60781de7b
[oauth] workaround for ctrl+c on Windows
7 years ago
9759fe8c6b
allow 'only_matching' tests
7 years ago
56bec79e6a
[reddit] add ability to load more comments ( #15 )
...
The 'extractor.reddit.morecomments' option enables the use of
the '/api/morechildren' API endpoint (1) to load even more
comments than the usual submission-request provides.
Possible values are the booleans 'true' and 'false' (default).
Note: this feature comes at the cost of 1 extra API call towards
the rate limit for every 100 extra comments.
(1) https://www.reddit.com/dev/api/#GET_api_morechildren
7 years ago
05ed95e5b0
[flickr] add search extractor
7 years ago
5f55c854b9
[flickr] replace getPublic... API call with regular ones
7 years ago
Mike Fährmann