2007cb2f59
[tests] check extractor category values
8 months ago
33f228756a
[mangadex] add 'list' extractor ( #5025 )
...
supports listing manga and chapters from list feed
9 months ago
57fc6fcf83
replace '24*3600' with '86400'
...
and generalize cache maxage values
9 months ago
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
1d2b5d0c60
update test comment positions
...
always put them above the test they're referring to
1 year ago
1ece3b92ff
[mangadex] allow multiple values for 'lang' ( #4093 )
...
This was already possible by setting 'lang' to a list of strings,
but now it can also be done as a more command-line friendly string.
-o lang=fr,it
1 year ago
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
f3cca50b9e
[mangadex] update links to API docs
1 year ago
2266fc8cc5
[mangadex] update and extend test results
1 year ago
1ce5dc9e18
fix whitespaces
1 year ago
13dedae09f
add status and tags info to mangadex extractor
1 year ago
3d8777fbc1
move user agent string to util.py
2 years ago
253ac08203
pre-define and use 'gallery-dö/<version>' UA string
2 years ago
cd931e1139
update extractor test results
2 years ago
4d1896830f
[mangadex] download chapters with 'externalUrl' ( fixes #2503 )
...
if the have pages hosted on mangadex
2 years ago
4ea9157d51
[mangadex] fix chapters without 'translatedLanguage' ( #2352 )
3 years ago
c587b678d0
[mangadex] re-enable warning for external chapters ( #2193 )
3 years ago
170711af7e
[mangadex] fix extraction ( closes #2177 )
3 years ago
11a3d96d13
[mangadex] load additional metadata using includes[] directives
...
- always provide 'artist', 'author', and 'group' metadata fields (#2049 )
- remove 'metadata' option
3 years ago
d93b5474c3
[mangadex] update parameter handling for API requests
...
- move common parameters into '_pagination()'
- add 'ratings' (#1908 ) and 'api-parameters' options
3 years ago
96215c926e
[mangadex] fix retrieving chapters from 'pornographic' titles
...
(fixes #1908 )
3 years ago
e69ee41f25
implement 'page-reverse' option ( #1854 )
3 years ago
6bbeaac029
[mangadex] fix extraction ( fixes #1852 )
3 years ago
ddd175de77
[mangadex] prevent KeyError for manga without English title
3 years ago
dfe1f490e9
[mangadex] use custom User-Agent header ( #1535 )
3 years ago
53dab5c289
[mangadex] revert chapter handling ( #1535 )
...
Spawn a new ChapterExtractor for each individual chapter
instead of handling them directly with a MangaExtractor.
Doing it that way broke too many features like
--chapter-filter, --chapter-range, --zip, etc.
3 years ago
1197ee2c20
[mangadex] add extractor for a user's followed feed ( #1535 )
3 years ago
07c8adbd8b
[mangadex] implement login with username & password ( #1535 )
3 years ago
3e332eaf53
[mangadex] update to API v5 ( #1535 )
3 years ago
69ea781d32
[mangadex] improve caching of manga results
...
'manga_id' being a string or integer are treated as two different keys
4 years ago
e58039358d
[mangadex] use 'api.mangadex.org' as default API server
...
The caching issues seem to be gone.
(#1290 , #1310 )
4 years ago
79c0fc249b
[mangadex] add 'api-server' option ( #1309 )
...
and change the API server back to 'https://mangadex.org/api ' for now
4 years ago
193dca2ce1
update extractor test results
4 years ago
b0cf968115
[mangadex] update API URLs
...
https://mangadex.org/thread/351011/9/#post_4238014
4 years ago
2c4d4a75db
[mangadex] respect 'chapter-reverse' settings ( closes #1194 )
...
The extractor in question doesn't inherit from MangaExtractor
and therefore didn't do this automatically.
4 years ago
e5d81bdc7b
[mangadex] handle 'external' chapters ( closes #1154 )
4 years ago
42ccae53c4
[mangadex] switch to API v2
...
https://mangadex.org/api/v2/
https://mangadex.org/thread/351011
4 years ago
43dab3a228
[mangadex] unescape more metadata fields ( fixes #1066 )
...
like 'manga', 'author', 'artist', etc.
4 years ago
7daef6ee70
update extractor test results
...
- certain posts on Instagram now return
https://static.cdninstagram.com/rsrc.php/null.jpg
for public users
- MangaDex is deploying its new MangaDex@Home network similar to
exhentai's Hentai@Home
- realbooru has a new site layout, but the underlying booru API still
works like before
4 years ago
3bad1579ee
update extractor test results
4 years ago
45baa13615
update extractor test results
...
- don't run Instagram tests on Travis anymore
- replace Twitter test because timeline was made private
- update Hiperdex domain to '.com' (again ...)
4 years ago
2530db3f4d
[mangadex] transform 'date' timestamps to datetime objects
5 years ago
af42c75152
[mangadex] revert domain to 'mangadex.org'
5 years ago
988cc2ec23
[mangadex] change domain to mangadex.cc ( closes #559 )
5 years ago
a2af2d2965
adjust cache maxage values
6 years ago
5530871b5a
change results of text.nameext_from_url()
...
Instead of getting a complete 'filename' from an URL and splitting that
into 'name' and 'extension', the new approach gets rid of the complete
version and renames 'name' to 'filename'. (Using anything other than
{extension} for a filename extension doesn't really work anyway)
Example: "https://example.org/path/filename.ext "
before:
- filename : filename.ext
- name : filename
- extension: ext
now:
- filename : filename
- extension: ext
6 years ago
61741d7333
provide type information for Queue messages
...
Child extractors are now directly constructed with Extractor.from_url()
if the extractor class is known beforehand, instead of using
extractor.find() and searching through all possible extractor classes.
6 years ago
580baef72c
change Chapter and MangaExtractor classes
...
- unify and simplify constructors
- rename get_metadata and get_images to just metadata() and images()
- rename self.url to chapter_url and manga_url
6 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
Mike Fährmann
