a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
d97b8c2fba
consistent cookie-related names
...
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
1 year ago
260ff55e19
[senmanga] ensure download URLs have a scheme ( #4235 )
1 year ago
ac651c604c
[senmanga] fix and update ( #4160 )
1 year ago
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
3 years ago
978cb03f81
update misc test results
...
- Livedoor now uses https:// for its image URLs
- Instagram image URLs got simplified
5 years ago
580baef72c
change Chapter and MangaExtractor classes
...
- unify and simplify constructors
- rename get_metadata and get_images to just metadata() and images()
- rename self.url to chapter_url and manga_url
6 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
966a9ca3a0
update test results
6 years ago
542a25c389
[ngomik] fix extraction
6 years ago
b4eca2633e
[tumblr] support /archive URLs
6 years ago
9e3415886c
[senmanga] fix/update tests
6 years ago
cc36f88586
rename safe_int to parse_int; move parse_* to text module
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
b8cdd42cab
[senmanga] fix extraction (again)
...
this is basically a re-revert of 2ace5c7
7 years ago
e6814aebe2
add 'extractor.*.user-agent' config option
7 years ago
92027f67f9
use consistent names for URL constants
...
root := <scheme>://<host>
base_url := <root>/<common path>
7 years ago
c4fcdf2691
Revert "[senmanga] fix extraction and download"
...
This reverts commit 2ace5c7b3c
7 years ago
2ace5c7b3c
[senmanga] fix extraction and download
7 years ago
a1c8b21cfd
[senmanga] improve metadata
7 years ago
58e95a7487
share extractor and downloader sessions
...
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
7 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
12c99293b6
allow extension by Content-Type for exhentai, seiga, senmanga
8 years ago
56d810c896
update keyword hashes for tests
8 years ago
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
b6a68775d4
[senmanga] add chapter extractor
8 years ago
Mike Fährmann