dd358b4564
improve cookie handling during logins
6 years ago
173add6935
[nijie] fix artist_id extraction
...
view_popup.php pages for older images or dojins either have the
artist_id value at a different place or not at all.
6 years ago
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
2d17a9e07f
improve extractor.request()
...
- better retry behavior
- exponential back-off
- removed 'allow_empty' argument
7 years ago
cc36f88586
rename safe_int to parse_int; move parse_* to text module
7 years ago
7b562907c3
[nijie] add favorites extractor
...
adds support for 'https://nijie.info/user_like_illust_view.php?id= ...'
7 years ago
445db75955
[nijie] improve extraction and metadata
...
- add 'title' and 'description'
- split 'artist_id' into 'user_id' and 'artist_id'
- 'user_id' is the ID of the user from which the image entry
originates from
- 'artist_id' is the ID of the actual image artist
- improve pagination and URL patterns
7 years ago
a112e3f2a0
[nijie] add doujin extractor
...
adds support for "https://nijie.info/members_dojin.php?id= <artist_id>"
7 years ago
3cec533c28
Merge branch 'archive'
7 years ago
f5f2d29f56
[nijie] fix dojin extraction
...
- correctly extract artist_id
- set extension to "jpg" if it was empty and let filetype checks do
the rest
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
9c138dfc1f
[common] detect empty HTTP response bodies
7 years ago
6f30cf4c64
change keyword names to valid Python identifiers
...
This commit mostly replaces all minus-signs ('-') in keyword names with
underscores ('_') to allow them to be used in filter-expressions. For
example 'gallery-id' got renamed to 'gallery_id'.
(It is theoretically possible to access any variable, regardless of its
name, with 'locals()["NAME"]', but that seems a bit too convoluted if
just 'NAME' could be enough)
7 years ago
915a0137de
improve 'extractor.request'
...
- add 'fatal' argument
- improve internal logic and flow
- raise known exception on error
- update exception hierarchy
7 years ago
7aa9fa796a
code cleanup and fixes
7 years ago
808f67ba7d
use 'cookiedomain' for cookies set by object-config-values
...
otherwise these cookies would not be picked up by the
_check_cookies() method.
7 years ago
0610ae5000
skip login if cookies are present
7 years ago
d3b04076f7
add .netrc support ( #22 )
...
Use the '--netrc' cmdline option or set the 'netrc' config option
to 'true' to enable the use of .netrc authentication data.
The 'machine' names for the .netrc info are the lowercase extractor
names (or categories): batoto, exhentai, nijie, pixiv, seiga.
7 years ago
4b967fa189
implement and use extractor.config() method
8 years ago
298d7c45f7
[nijie] support multi-page image listings
8 years ago
1d46be545c
add login notifications
8 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
4a8d74973c
adjust login methods to a specific style
8 years ago
7952b8d18d
add a few tests expecting exceptions
8 years ago
56d810c896
update keyword hashes for tests
8 years ago
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
fea3be0aed
[nijie] add image-extractor
8 years ago
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
dcd213f13e
[nijie] raise NotFoundError
8 years ago
d01b21c6c8
[nijie] change 'email'-parameter to 'username'
8 years ago
0ba9601b63
[nijie] raise AuthError
8 years ago
10fcc010bb
[nijie] cache login sessions
9 years ago
2449532132
add more extractor test-cases
9 years ago
75ff08f73c
[nijie] proper login and other issues fixed
9 years ago
4d56b76aa8
update all other extractors
9 years ago
c2f0720184
code cleanup to use nameext_from_url
9 years ago
3c13548f29
rewrite extractors to use config-module
9 years ago
42b8e81a68
rewrite extractors to use text-module
9 years ago
a145a73d05
add extractor 'nijie'
10 years ago
Mike Fährmann