0e3883303f
[pixiv] implement AppAPI wrapper
6 years ago
f9884e2338
[pixiv] update URL pattern
...
add support for 'https://www.pixiv.net/user/ <id>'
7 years ago
1d71123f91
[pixiv] update archive IDs and add metadata-fields
...
(Pixiv bookmarks actually have their own IDs, comments and tags,
independent of the bookmarked image, which makes creating an
archive ID a lot easier)
7 years ago
367b963d37
[pixiv] fix ugoira extraction ... again ( #78 )
...
Some animations are not available for mobile devices, so we
pretend to be a desktop browser when requesting the ugoira page.
7 years ago
b79f1f2ca7
[pixiv] fix ugoira extraction ( closes #78 )
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
c24e0e70a7
[pixiv] simplify main loop
7 years ago
4d8387f93b
[pixiv] support mobile URLs ( https://touch.pixiv.net/ )
7 years ago
b319f4bab3
smaller code and text changes
7 years ago
ad4580800c
[pixiv] add support for more URL patterns
...
- https://www.pixiv.net/mypage.php#id=USERID
- https://www.pixiv.net/#id=USERID
7 years ago
0dedbe759c
enable '--chapter-filter'
...
The same filter infrastructure that can be applied to image URLS now
also works for manga chapters and other delegated URLs.
TODO: actually provide any metadata (currently supported is only
deviantart and imagefap).
7 years ago
47bcf53ec1
implement support for additional unit test result types
...
- "pattern" matches all resulting URLs against the given regex
- "count" allows to specify the amount of returned URLs
7 years ago
f7cdfd4c25
add a simplified version of 'parse_qs'
...
This version only returns a dict of plain string to string key-value
pairs and ignores multiple values for the same query variable.
7 years ago
e61a3a56d1
[hentai2read] fix and update keywords
...
Added the "author" keyword and changed the name of a few others to be
consistent with other manga/chapter extractors.
7 years ago
c45770331a
use 'str.partition()'
...
The (r)partition method is always faster then split() or any other
method that has been replaced in this commit.
7 years ago
017a72f448
[pixiv] improve input validation
7 years ago
dcf42c5e89
[pixiv] add extractor for ranking lists
7 years ago
7aa9fa796a
code cleanup and fixes
7 years ago
f08af03845
Merge branch 'cookies'
7 years ago
b37a62501b
[pixiv] unquote tags
7 years ago
58e95a7487
share extractor and downloader sessions
...
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
7 years ago
44d98e562b
[pixiv] support pixiv.me URLs ( #23 )
7 years ago
b373fe0eea
[pixiv] support shortened URLs and other variants ( #23 )
7 years ago
d3b04076f7
add .netrc support ( #22 )
...
Use the '--netrc' cmdline option or set the 'netrc' config option
to 'true' to enable the use of .netrc authentication data.
The 'machine' names for the .netrc info are the lowercase extractor
names (or categories): batoto, exhentai, nijie, pixiv, seiga.
7 years ago
e365f1d799
[pixiv] rewrite
...
- same functionality, better(?) code quality, easier to extend
- added test for the user-tag functionality
- removed the 'artist-id', 'artist-name' and 'artist-nick'
keywords, which can be replaced with 'user[id]', 'user[name]'
and 'user[account]' respectively
7 years ago
338f79147f
[pixiv] support tag for user downloads ( #17 )
...
[pixiv] support tag for user downloads
7 years ago
107d29ad8a
improve handling of text:... URLs
...
- don't require // after the colon
- open output files in text mode
7 years ago
cfbf79d788
[pixiv] fix login
7 years ago
4e8587bad4
[pixiv] add support for https://i.pximg.net URLs
7 years ago
4b967fa189
implement and use extractor.config() method
8 years ago
13dc5d72bc
update some extractors to use https
8 years ago
f4aa452bd1
update unit test results
8 years ago
1d46be545c
add login notifications
8 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
4a8d74973c
adjust login methods to a specific style
8 years ago
7952b8d18d
add a few tests expecting exceptions
8 years ago
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
30d10cf595
[pixiv] fix KeyError if no status is present
8 years ago
effa1084f2
[pixiv] raise NotFoundError instead of failing
8 years ago
85cd7c34b1
[pixiv] match direct-links to images
8 years ago
0e20be5a0a
[exhentai] provide username/password auth
8 years ago
3136278f79
[pixiv] add option to skip ugoiras
8 years ago
d6c06f9efd
add authentication-exception
8 years ago
c9b7db5af5
[pixiv] code cleanup
9 years ago
c8e83f6560
[pixiv] cache login sessions
9 years ago
23a572a20d
[pixiv] update testdata
9 years ago
ba99506c72
more extractor test-cases
9 years ago
f7c47a6018
add subcategories to extractors
9 years ago
1497da07de
remove unused format-strings
9 years ago
a4c880f4c5
[pixiv] add bookmark extractor
9 years ago
daf5fcd416
[pixiv] add user-favorite extractor
9 years ago
20a4782173
[pixiv] get rid of an unnecessry api-call
9 years ago
2a97296e69
[pixiv] add single work/illust extractor
9 years ago
4d56b76aa8
update all other extractors
9 years ago
f5d5684119
[pixiv] reuse api-tokens
9 years ago
c8e0efe1ff
[pixiv] refresh access-token every 50 minutes
9 years ago
539faa0322
remove SequentialExtractor class
9 years ago
3c13548f29
rewrite extractors to use config-module
9 years ago
42b8e81a68
rewrite extractors to use text-module
9 years ago
1998ec9b13
[pixiv] update user-agent to newest version
9 years ago
63992363a6
[pixiv] handle timestamps at the end of urls
9 years ago
d9d88f1448
[pixiv] fix ugoira parsing
9 years ago
68c4306040
[pixiv] transition to pixiv public api
9 years ago
fae1b28c48
[pixiv] fix parsing of illust_ids
10 years ago
8f24329e30
[pixiv] fix http headers and cookies
10 years ago
1cd25b5369
[pixiv] update to new extractor interface
10 years ago
d13608e909
[pixiv] fix parsing of illust-ids
10 years ago
54d40b85fb
[pixiv] load balancing for image servers
10 years ago
deef91eddc
initial commit
10 years ago
Mike Fährmann