66460337f1
[mangapark] fix extraction
6 years ago
8aba2bdebf
[postprocessor:metadata] add 'tags' and 'custom' modes ( #135 )
6 years ago
79c01ec7ae
implement J<separator>/ format option
...
J joins list elements by calling <separator>.join(list):
Example:
{f:J - /} -> "a - b - c" (if "f" is ["a", "b", "c"])
6 years ago
2ffc105887
[exhentai] extract tag metadata
6 years ago
0fb98d1d79
[hbrowse] extract tag metadata
6 years ago
9bbbadd93a
[hbrowse] use HTTPS
6 years ago
2fbf072723
[newgrounds] ensure consistent tag order
...
... plus some code restructuring
6 years ago
d7a4739cf6
[hbrowse] print error message if site is down
...
... instead of crashing with a meaningless exception
6 years ago
98c6520384
[pinterest] update root URL of API calls
6 years ago
751e535948
[nhentai] fix extraction ( closes #156 )
...
Use JSON embedded in webpage since API endpoints have been disabled
6 years ago
5f38ac9609
[postprocessor:exec] add a better error message ( #155 )
6 years ago
89df37a173
[artstation] use a separate dict for each asset ( #154 )
...
Using the same base-dict for each asset of a project causes unwanted
side effects like re-using image filename extensions for videos,
resulting in errors with the youtube-dl downloader.
6 years ago
344bbaa71a
remove useless line
...
A remnant from when `filter` and `range` were global and only
available as command line options.
6 years ago
1734a6c879
[reactor] detect "circular" redirects ( #148 )
6 years ago
e53cdfd6a8
update build_supportedsites.py
6 years ago
1e4d351ad3
[danbooru] add authentication support ( closes #151 )
...
... via HTTP Basic Auth with username and "password".
The password value in this case is not the account password itself,
but the"api_key" found in your user profile.
6 years ago
06cbf5f9c4
implement 'chapter-reverse' option ( #149 )
...
Setting it to `true` will start with the latest chapter instead of the
first one.
6 years ago
e95b24f056
[reactor] add wait-min & -max options ( #148 )
6 years ago
8e01cf0ef8
[reactor] generalize extractors ( #148 )
...
- support *.reactor.cc domains
- combine joyreactor and pornreactor modules
6 years ago
38500ad697
[postprocessor:metadata] first implementation ( #135 )
6 years ago
1737d7f576
[joyreactor] fix and improve pagination ( #148 )
6 years ago
8753627ef4
[joyreactor] improve error handling for faulty JSON ( #148 )
...
- remove all ASCII escape codes, not just \n and \r
- ignore faulty posts instead of letting the exception propagate
6 years ago
a36f52a730
[joyreactor] add extractor for search results ( #148 )
6 years ago
a303efb597
[mangadex] handle manga pages without chapters
6 years ago
0afa913de4
[tumblr] add tests for hidden and private blogs ( #145 )
...
Hidden / dashboard-only blogs are pretty straightforward and "only"
require a valid 'access-token' and 'access-token-secret' for the given
'api-key' and 'api-secret', so that signed OAuth1.0 requests are possible.
Private / password protected blogs on the other hand are a bit
cumbersome. In addition to a valid 'access-token' and
'access-token-secret', they also require the account belonging to those
tokens to be a member of the blog itself. Knowing the password and
entering it in the website isn't enough to access a blog through the
API. Following a private blog is also impossible, so that option can't
work either.
6 years ago
67cc0ac873
release version 1.6.2
6 years ago
fa7fa2f8ff
[deviantart1 update tests]
6 years ago
b7b5456a32
[kissmanga] use HTTPS
6 years ago
259123732f
[readcomiconline] improve comic-page parsing
6 years ago
0328a04a65
[cloudflare] don't output the whole challenge page
...
thanks to the embedded animated gifs this is just a bit too much
6 years ago
4ab0960083
[reddit] add metadata to extracted URLs
6 years ago
2f4f60de33
[tumblr] add tests for each post type
6 years ago
98314aa04c
[mangapark] detect non-existent chapters
6 years ago
6c71e9cf5d
[deviantart] add separate 'sta.sh' extractor ( #113 )
...
- supports multiple stashed deviations per page
- explicitly mentions sta.sh support on supportedsites.rst
6 years ago
f9ace0f4a3
[mangapark] fix manga extraction ... again
6 years ago
28f9539551
[tumblr] change default values for post types and inline media
6 years ago
5be95034ba
[tumblr] add option to download avatars ( #137 )
6 years ago
7471933d5f
use extractor.request for all other API calls
...
- deviantart
- pawoo
- pixiv
- reddit
6 years ago
995844c915
[instagram] relax test pattern even more
6 years ago
2e5f82e59e
[tumblr] don't follow 'external' Tumblr URLs ( #139 )
6 years ago
c5d4f558c9
allow missing field access keys in format strings ( #136 )
6 years ago
0c9762f00e
[mangapark] fix extraction
6 years ago
c9ef5ed364
[luscious] ensure URLs have a scheme
6 years ago
851ee9f89f
[sensescans] replace tests
...
the old ones got removed
6 years ago
c14d44e1bc
[downloader:common] retry downloads on SSL errors ( #130 )
6 years ago
0be7ee3106
[hitomi] fix image subdomains ( closes #142 )
...
galleries with an ID ending in 1 need some special treatment
6 years ago
fe96835d25
[kissmanga] add fallback for chapter-string parsing ( #20 )
6 years ago
4d73cc785d
update test results
6 years ago
049a9575c4
[tumblr] fix inline extraction #2
...
Using only the "comment" field isn't enough ...
[ci skip]
6 years ago
f6bf66f72c
[pixiv] create directory for each "work" item ( #136 )
6 years ago
Mike Fährmann