Mike Fährmann
|
9c29fc4e55
|
always initialize DownloadJob.hooks (fixes #1135)
and not just when any (potential) post processors are defined
|
4 years ago |
|
Mike Fährmann
|
ae6a1d5fbc
|
[mangoxo] fix extraction 2
|
4 years ago |
|
Mike Fährmann
|
0bc492c0fa
|
add docs for 'event' and 'filename' options
from 9c3568c3 and ca59bd69
|
4 years ago |
|
Mike Fährmann
|
f6a684bc37
|
[hentainexus] update data decoding procedure (#1125)
|
4 years ago |
|
Mike Fährmann
|
c57a918f4a
|
[e621] implement delay via '_request_interval_min'
|
4 years ago |
|
Mike Fährmann
|
93ce7466e2
|
[2chan] skip external links
|
4 years ago |
|
Mike Fährmann
|
547107307e
|
fix 'Metadata' messages in result tests
|
4 years ago |
|
Mike Fährmann
|
b214e89b5c
|
[mangoxo] fix extraction
|
4 years ago |
|
Mike Fährmann
|
578dcf805c
|
[mangapanda] don't force https://
|
4 years ago |
|
Mike Fährmann
|
102c482f5e
|
[reddit] skip invalid/failed gallery items (fixes #1127)
|
4 years ago |
|
Mike Fährmann
|
174945d2b2
|
[hentainexus] fix extraction (fixes #1125)
|
4 years ago |
|
Mike Fährmann
|
ca59bd691c
|
[postprocessor:metadata] add 'event' and 'filename' options
|
4 years ago |
|
Mike Fährmann
|
9c3568c397
|
[postprocessor:exec] add 'event' option
and remove 'final' option -- use '"event": "finalize"' instead.
|
4 years ago |
|
Mike Fährmann
|
9fffa9c343
|
rework post processor callbacks
|
4 years ago |
|
Mike Fährmann
|
d6986be8b0
|
Move CI to GitHub Actions
|
4 years ago |
|
Mike Fährmann
|
f99c6031e0
|
apply post processor blacklists/whitelists to basecategories
(#1103)
|
4 years ago |
|
Mike Fährmann
|
1e3dd7330e
|
merge SharedConfigMixin functionality into Extractor
|
4 years ago |
|
Mike Fährmann
|
ddfb4fd07a
|
[twitter] use 'https://twitter.com/i/api/' for logged in users
Doesn't seem to make a difference from what I can tell,
i.e. downloaded files are the same, but the website does it.
|
4 years ago |
|
Mike Fährmann
|
42ccae53c4
|
[mangadex] switch to API v2
https://mangadex.org/api/v2/
https://mangadex.org/thread/351011
|
4 years ago |
|
Mike Fährmann
|
ca44111726
|
[flickr] update
- ensure every photo has an 'owner' (#828)
- change default directories to a more consistent schema
- create directory for each photo
|
4 years ago |
|
Mike Fährmann
|
9b1bd09454
|
change 'extension-map' default
Replace all JPEG filename extensions with 'jpg'.
|
4 years ago |
|
Mike Fährmann
|
e5438b8a29
|
release version 1.15.3
|
4 years ago |
|
Mike Fährmann
|
de0c57886d
|
[twitter] add 'list-members' extractor (closes #1096)
|
4 years ago |
|
Mike Fährmann
|
904ba08568
|
[gfycat] fix default filename format
|
4 years ago |
|
Mike Fährmann
|
a46561bc16
|
[500px] update query hashes
|
4 years ago |
|
Mike Fährmann
|
2e3a0dff21
|
[8kun] fix file URLs of older posts (fixes #1101)
|
4 years ago |
|
Mike Fährmann
|
00825cddf5
|
[hentaifoundry] use scheme from input URL (fixes #1095)
Let the user choose between http and https,
instead of always forcing https.
|
4 years ago |
|
Mike Fährmann
|
8a98d3549a
|
[weasyl] create directory for each favorite submission
(#1032)
|
4 years ago |
|
Mike Fährmann
|
91db8df1c7
|
[deviantart] add 'index_base36' metadata field (closes #1099)
This is the same ID as found in 'filename' without the 'd' in front,
which is just 'index' encoded in base36.
|
4 years ago |
|
Mike Fährmann
|
b9bfa4c675
|
update extractor test results
|
4 years ago |
|
Mike Fährmann
|
1b5b789401
|
[mangoxo] fix metadata extraction
|
4 years ago |
|
Mike Fährmann
|
41d4968866
|
[twitter] add 'list' extractor (#1096)
|
4 years ago |
|
Mike Fährmann
|
5d10520f4c
|
[twitter] update GraphQL endpoint & fix width/height entries
|
4 years ago |
|
Mike Fährmann
|
bc7b1d91bc
|
fix rST markup in configuration.rst
[ci skip]
|
4 years ago |
|
Mike Fährmann
|
9b2e5f72d6
|
[exhentai] update image URL parsing (#1094)
|
4 years ago |
|
Mike Fährmann
|
e3480bc8de
|
implement 'extension-map' option (#318)
|
4 years ago |
|
Mike Fährmann
|
98a4d86a01
|
[sankakucomplex] extract videos and embeds (closes #308)
|
4 years ago |
|
Mike Fährmann
|
c3f01dc4e6
|
implement 'util.unique()'
|
4 years ago |
|
Mike Fährmann
|
558cde139c
|
[paheal] fix extraction (fixes #1088)
|
4 years ago |
|
Mike Fährmann
|
0211af7ca8
|
[hentaifoundry] update 'YII_CSRF_TOKEN' cookie handling
(fixes #1083)
|
4 years ago |
|
Mike Fährmann
|
d83b95fd28
|
[postprocessor:metadata] accept a string-list for 'content-format'
(closes #1080)
|
4 years ago |
|
Mike Fährmann
|
198c33ec36
|
also collect post processors from 'basecategory' entries
(fixes #1084)
|
4 years ago |
|
Mike Fährmann
|
350b1afe1c
|
speed up _list_classes() after iterating over all modules once
|
4 years ago |
|
Mike Fährmann
|
5bcf28de93
|
add a 'extractor.modules' option
|
4 years ago |
|
Mike Fährmann
|
18213dc5ba
|
release version 1.15.2
|
4 years ago |
|
Mike Fährmann
|
de4a1e45c9
|
improve 'generate_csrf_token()'
no need to use hashlib.md5()
|
4 years ago |
|
Mike Fährmann
|
b788712844
|
[fallenangels] fix extraction of '.5' chapters
|
4 years ago |
|
Mike Fährmann
|
28d8541cb3
|
[mangafox] ensure download URLs have a scheme
|
4 years ago |
|
Mike Fährmann
|
8e3a324c91
|
[mangakakalot] ignore "Go Home" buttons in chapter pages
|
4 years ago |
|
Mike Fährmann
|
c14c5d82d6
|
[newgrounds] use generator for fallback URLs
|
4 years ago |
