e33125ad39
[pixiv] add 'sketch' extractor ( #1497 )
3 years ago
eed6ef3de0
[pixiv] fix pixivision title extraction
3 years ago
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
3 years ago
8ecca3af58
[pixiv] add extractor for 'pixivision' articles ( #1672 )
3 years ago
7273cf8536
[pixiv] support fetching privately followed users ( fixes #1628 )
3 years ago
e6811c7450
[pixiv] implement 'max-posts' option ( #1558 )
...
* implement max-rank for pixiv
* rename to max-posts and make more generic
3 years ago
5eeaaee01d
[pixiv] add 'metadata' option ( #1551 )
3 years ago
36ed1efcfb
[pixiv] rename "noop" value for 'tags' option to "original"
...
(#1507 )
3 years ago
fa519f9202
[pixiv] change 'translated-tags' option ( #1507 )
...
- rename to 'tags'
- use string-values: "japanese", "translated", "noop"
- remove duplicate entries for "translated" tags
3 years ago
221015e586
[downloader:http] disable filename extension changes for ugoira
...
(#1507 )
3 years ago
141ca4ac0a
[pixiv] also save untranslated tags when translated-tags is enabled ( #1501 )
3 years ago
5ad615f0db
fix PixivFavoriteExtractor regex ( #1405 )
...
* fix PixivFavoriteExtractor regex
* do not use lookbehind
4 years ago
7440d1f112
[pixiv] add 'translated-tags' option ( closes #1354 )
...
(a lot more straight forward than I thought ...)
4 years ago
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
4 years ago
193dca2ce1
update extractor test results
4 years ago
c008cb5100
[pixiv] add 'related' option ( #1237 )
4 years ago
3bd08acc8f
[pixiv] output debug message on failed login attempt
...
(#1192 )
4 years ago
b58e605dc7
raise error when required username or password are missing
...
do not try to login as 'None' (#1192 )
4 years ago
968d3e8465
remove '&' from URL patterns
...
'/?&#' -> '/?#' and '?&#' -> '?#'
According to https://www.ietf.org/rfc/rfc3986.txt , URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
4 years ago
844793847c
update extractor test results
4 years ago
844502cad5
update extractor test results
4 years ago
a45fbc38ea
[pixiv] implement 'avatar' option ( #595 , #623 )
5 years ago
ce26070231
[pixiv] reduce calls to '/user/detail'
5 years ago
b7eb6cecbb
[pixiv] handle tags at the end of new bookmark URLs
5 years ago
40fe062851
[pixiv] fix user id for bookmarks API calls ( closes #596 )
5 years ago
91aaaf1a9e
[pixiv] add 'rating' metadata field ( #595 )
...
A human-friendlier representation of 'x_restrict'
5 years ago
71851a6241
[pixiv] update URLs of followed users to the new format
5 years ago
b9cbf932b4
[pixiv] update URL patterns ( fixes #568 )
...
Pixiv now uses new URLs for
- user profiles and illustration listings:
- https://www.pixiv.net/en/users/ <ID>
- https://www.pixiv.net/en/users/ <ID>/artworks
- bookmarks:
- https://www.pixiv.net/en/users/ <ID>/bookmarks/artworks
5 years ago
ce54b8c04c
let extractors opt-out of cookie option usage
...
useful to avoid sending unnecessary cookies when all authentication
is done through OAuth tokens
5 years ago
1f2a69f3c5
add '_extractor' information to redirect results
5 years ago
a27f43dad1
[pixiv] wait and retry after rate limit error ( closes #535 )
5 years ago
c0f391a4e2
[pixiv] support listing followed users ( #515 )
5 years ago
1f209da4c0
[pixiv] match new search URLs ( closes #507 )
5 years ago
4409d00141
embed error messages in StopExtraction exceptions
5 years ago
22bac14452
[pixiv] match '/artworks/' URLs
5 years ago
f9285f99e6
[pixiv] fix authentication
5 years ago
32447d0d24
[pixiv] simplify default filename format
...
(#366 )
5 years ago
ad3ac02fbc
[pixiv] update metadata entries ( #366 )
...
- change 'num' to a simple enumerating integer
- change default filename format
- provide content of the old 'num' field as 'suffix'
- add 'filename' for ugoira
5 years ago
64b2935d8e
[pixiv] provide 'filename' and change default filename format
...
to '{filename}.{extension}' (closes #366 )
5 years ago
fdec59f8e2
replace extractor.request() 'expect' argument
...
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
5 years ago
b0e85a42e3
apply workaround from 4736912 in parse_datetime() itself
5 years ago
4736912d4e
[pixiv] work around strptime limitations in Python < 3.7
...
"%z" doesn't allow a colon separator in older Python versions:
- "+0900" is OK
- "+09:00" raises an exception
5 years ago
80fdb11508
[pixiv] add 'date' metadata field ( closes #248 )
5 years ago
a2af2d2965
adjust cache maxage values
6 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
34bab080ae
rewrite URL patterns to use only 1 per extractor
6 years ago
7471933d5f
use extractor.request for all other API calls
...
- deviantart
- pawoo
- pixiv
- reddit
6 years ago
f6bf66f72c
[pixiv] create directory for each "work" item ( #136 )
6 years ago
8faf03ed84
[pixiv] use refresh_token based authentication
...
The first login will still use username and password, but everything
afterwards will use the refresh_token obtained from that.
This will prevent pixiv from sending a "New login to pixiv" email every
time a new access_token is requested.
6 years ago
Mike Fährmann