Commit Graph

2468 Commits (6e3658ef52bdbc43cba55ecda6f13c0702d608e3)

Author SHA1 Message Date
Mike Fährmann dfe1f490e9
[mangadex] use custom User-Agent header (#1535)
3 years ago
Mike Fährmann 36a2aff363
[vk] improve metadata extraction and URL pattern (fixes #1691)
3 years ago
Mike Fährmann e622e004f0
[ytdl] improve module imports (#1680)
3 years ago
Mike Fährmann 193401ce3b
[ytdl] "fix" cookie transfer between session and ytdl (#1680)
3 years ago
Mike Fährmann 9a849cdf61
[ytdl] allow setting 'module' for subcategories (#1680)
3 years ago
Mike Fährmann dff0da60f9
[ytdl] add 'generic' option (#1680)
3 years ago
Mike Fährmann d3da96142a
[ytdl] support cookies + username&password (#1680)
3 years ago
Mike Fährmann 36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
3 years ago
Mike Fährmann 64240c8d42
[imagevenue] fix extraction
3 years ago
Mike Fährmann d287d2eb88
[kemonoparty] parse 'o' query parameters (#1674)
3 years ago
Mike Fährmann 8b036778e3
[kemonoparty] add 'max-posts' option (#1674)
3 years ago
Mike Fährmann 5612ca31c2
[hitomi] fix image URLs (closes #1679)
3 years ago
Mike Fährmann 8ecca3af58
[pixiv] add extractor for 'pixivision' articles (#1672)
3 years ago
Mike Fährmann 312a28e78a
[mastodon] add 'replies' option (#1669)
3 years ago
Mike Fährmann 513c491cea
[mastodon] reset 'params' after first pagination iteration
3 years ago
Mike Fährmann a1f5b78039
[mastodon] add 'reblogs' option (#1669)
3 years ago
Mike Fährmann 21c2da454f
update extractor test results
3 years ago
Mike Fährmann 7f591c78cb
[mangafox] cleanup
3 years ago
FollieHiyuki 4763bc1e4e
Add MangaExtractor for mangafox (#1633)
3 years ago
Mike Fährmann b519bf567c
[hiperdex] use domain from input URL
3 years ago
Mike Fährmann 93d356712c
[mastodon] implement 'text-posts' option (#1569)
3 years ago
Mike Fährmann 414bdc95a3
[twitter] set 'retweet_id' for original retweets (#1481)
3 years ago
Mike Fährmann 5323c1c73a
[twitter] ensure guest tokens are returned as string (#1665)
3 years ago
Mike Fährmann 9ee45f3617
[kemonoparty] warn about missing DDoS-GUARD cookies
3 years ago
Mike Fährmann 344aab3fb7
[seisoparty] warn about missing DDoS-GUARD cookies
3 years ago
Mike Fährmann 035562bd11
[twitter] remove old-style URLs from image fallback lists
3 years ago
Mike Fährmann daf821b8b6
[seisoparty] use user names instead of IDs by default (#1635)
3 years ago
Mike Fährmann e4db1bad14
[seisoparty] also extract files hosted on 'cdn-2' servers (#1635)
3 years ago
Mike Fährmann 267bbf5996
[mangasee] add 'chapter' and 'manga' extractors
3 years ago
Mike Fährmann fad4918208
[deviantart] use UUIDs in internal folder/collection URLs
3 years ago
Mike Fährmann 0179581340
add 'T' format string conversion (#1646)
3 years ago
Mike Fährmann f74cf52e2b
[seisoparty] add 'user' and 'post' extractors (#1635)
3 years ago
Mike Fährmann 759735fb02
[kemonoparty] fix 'username' extraction (fixes #1652)
3 years ago
Mike Fährmann a416e54765
[directlink] manually encode Referer URLs (fixes #1647)
3 years ago
Mike Fährmann 8bdeb2a6dd
[webtoons] match arbitrary language codes (closes #1643)
3 years ago
Mike Fährmann 4adc44df69
[furaffinity] improve metadata extraction (fixes #1630)
3 years ago
Mike Fährmann e98fa01c44
[hitomi] update image URL code (fixes #1637)
3 years ago
Mike Fährmann e9ab97396f
[kemonoparty] update default filenames and archive IDs (#1514)
3 years ago
Mike Fährmann fb4b4725ba
[hiperdex] match 'hiperdex2.com' URLs
3 years ago
Mike Fährmann 95bc1139e0
[instagram] update query hashes
3 years ago
Mike Fährmann 23018a46f6
[instagram] fix login (fixes #1631)
3 years ago
Mike Fährmann cac0110d8b
[redgifs] update API server address (fixes #1632)
3 years ago
Mike Fährmann 0d2961ae81
[500px] remove last query hash entry
3 years ago
Mike Fährmann 7273cf8536
[pixiv] support fetching privately followed users (fixes #1628)
3 years ago
Mike Fährmann e60962f7e5
[philomena] improve tag escapes handling (fixes #1629)
3 years ago
Mike Fährmann d8908ca577
[unsplash] update collections URL pattern (fixes #1627)
3 years ago
Mike Fährmann 9ed13703cc
[sankaku] handle empty tags (fixes #1617)
3 years ago
Mike Fährmann b56e245094
[500px] update GraphQL queries
3 years ago
Mike Fährmann a751afdfb3
[twitter] change some defaults
3 years ago
Mike Fährmann 4e4ca3c330
[deviantart] pin API version (#1611)
3 years ago
Mike Fährmann d09bc5bd34
[subscribestar] improve attachment filenames (#1609)
3 years ago
Mike Fährmann 2986bf63bf
[mangafox] update URL pattern (fixes #1608)
3 years ago
Mike Fährmann 53dab5c289
[mangadex] revert chapter handling (#1535)
3 years ago
Mike Fährmann 1197ee2c20
[mangadex] add extractor for a user's followed feed (#1535)
3 years ago
Mike Fährmann 07c8adbd8b
[mangadex] implement login with username & password (#1535)
3 years ago
Mike Fährmann 3e332eaf53
[mangadex] update to API v5 (#1535)
3 years ago
Mike Fährmann 04f4f9badb
[oauth] prevent exceptions when reporting errors (#1603)
3 years ago
Mike Fährmann a3bf878329
[idolcomplex] improve and fix pagination (#1601)
3 years ago
Mike Fährmann e39c4633ba
[cyberdrop] b64decode -> a2b_base64
3 years ago
Mike Fährmann 407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595)
3 years ago
Mike Fährmann 78f89d2e61
[idolcomplex] fix pagination (closes #1594)
3 years ago
Mike Fährmann 52052a0e1a
[manganelo] update domain to 'manganato.com'
3 years ago
Mike Fährmann c80b18a477
[weibo] extend 'retweets' option (closes #1542)
3 years ago
Mike Fährmann c0fa5058da
[kemonoparty] actually add a 'type' metadata field (#1556)
3 years ago
thatfuckingbird 264beb8556
recognize v2.mangapark URLs (#1578)
3 years ago
thatfuckingbird e6811c7450
[pixiv] implement 'max-posts' option (#1558)
3 years ago
Mike Fährmann 8a909e478d
[imagebam] fix extraction of NSFW images (#1534)
3 years ago
Mike Fährmann b5affc62aa
[twitter] rename 'text-only' to 'text-tweets' (#570)
3 years ago
Mike Fährmann 724ca61f36
[twitter] add 'text-only' option (#570)
3 years ago
Mike Fährmann 8fd8126117
fix ISO 639-1 code for Japanese
3 years ago
Mike Fährmann 2c60c7d798
[reactor] skip deleted/empty posts
3 years ago
Mike Fährmann 532ac79fb0
update extractor test results
3 years ago
Mike Fährmann d7bc4a2b8b
[500px] update query hashes
3 years ago
Mike Fährmann 0f35aca728
[aryion] minor code updates
3 years ago
Mike Fährmann 2eb46452ad
[aryion] update 'needle' to not skip text posts (fixes #1568)
3 years ago
Mike Fährmann 4fc9668922
[imgur] update URL patterns (#1561)
3 years ago
Mike Fährmann 1eabfa5c7a
[pillowfort] implement login with username & password (#846)
3 years ago
Mike Fährmann 24dd10ac3c
[patreon] extract user defined 'tags' (#1539, closes #1540)
3 years ago
Mike Fährmann a7e4917ee1
[pillowfort] add 'inline' option (#846)
3 years ago
Mike Fährmann efa6cc8ec3
[pillowfort] add 'external' option (#846)
3 years ago
Mike Fährmann 394fbb5f56
[twitter] strip useless t.co links (#1532)
3 years ago
Mike Fährmann 41457dbb1b
[twitter] resolve t.co URLs in 'content' (#1532)
3 years ago
Mike Fährmann 2b5d80862e
[kemonoparty] add 'type' metadata field (#1556)
3 years ago
Mike Fährmann 17b0ccb071
[twitter] add missing retweet media entities (fixes #1555)
3 years ago
Mike Fährmann 5eeaaee01d
[pixiv] add 'metadata' option (#1551)
3 years ago
Mike Fährmann 0717456b4e
[kemonoparty] add 'metadata' option (closes #1548)
3 years ago
Mike Fährmann 36ed1efcfb
[pixiv] rename "noop" value for 'tags' option to "original"
3 years ago
Mike Fährmann 14f983eab6
[deviantart] use default ID when 'client-id' is None
3 years ago
Mike Fährmann 3e4ffb0821
[gelbooru] add extractor for '/redirect.php' URLs (#1530)
3 years ago
Mike Fährmann 5e54105ae4
[instagram] update query hashes
3 years ago
Mike Fährmann b3ee10a7fb
[500px] update query hashes
3 years ago
Mike Fährmann 15b0241bbc
[imagebam] fix extraction
3 years ago
Mike Fährmann 38ae61edd4
[inkbunny] add 'favorite' extractor (#1521)
3 years ago
Mike Fährmann 577fffad5f
[nozomi] update 'archive_fmt' values for tag and search extractors
3 years ago
Mike Fährmann c5ca7905ce
add 'noop()' and 'identity()' functions
3 years ago
HRXN e13cae182b
[nozomi] Extend default archive-fmt for Tag and Search Extractor (#1529)
3 years ago
Mike Fährmann 2133f1d77f
[readcomiconline] change domain to 'readcomiconline.li'
3 years ago
Mike Fährmann 66f28e471c
[kemonoparty] update file URLs directly linking to kemono.party
3 years ago
Mike Fährmann 6fa20d456b
[sankaku] update invalid-token detection (fixes #1515)
3 years ago
Mike Fährmann 4b65ebf652
[kemonoparty] fix file URLs (#1514)
3 years ago
Mike Fährmann fa519f9202
[pixiv] change 'translated-tags' option (#1507)
3 years ago
Mike Fährmann 221015e586
[downloader:http] disable filename extension changes for ugoira
3 years ago
thatfuckingbird e47952ac14
add extractors for fantia and fanbox (#1459)
3 years ago
Mike Fährmann d900edfcfb
[simplyhentai] fix extraction
3 years ago
Mike Fährmann ba8180b5e6
[bcy] don't crash with deleted posts
3 years ago
Mike Fährmann d108421461
[myportfolio] fix extraction
3 years ago
Mike Fährmann 8b22d4e667
[mangapark] use '"browser": "firefox"' by default
3 years ago
Mike Fährmann 9514cb8c12
[exhentai] update 'limits' check (#1487)
3 years ago
thatfuckingbird 141ca4ac0a
[pixiv] also save untranslated tags when translated-tags is enabled (#1501)
3 years ago
Renan Vedovato Traba 9322c5e43b
[exhentai] restore limit config (#1487)
3 years ago
Mike Fährmann cb86bb9cc9
[hentaicosplays] add 'slug' metadata field (closes #1483)
3 years ago
Mike Fährmann dddda7d0e7
[hentaicosplays] use GalleryExtractor (#1473)
3 years ago
Mike Fährmann d88e34f17e
[webtoons] use GalleryExtractor
3 years ago
Mike Fährmann c4210b5371
[webtoons] update agegate/GDPR cookies
3 years ago
Mike Fährmann d89eb7536b
[naverwebtoon] use GalleryExtractor
3 years ago
Mike Fährmann 9b52eb9bf1
[naverwebtoon] ignore non-comic images
3 years ago
Mike Fährmann bdfcc9c4b1
update extractor test results
3 years ago
Hans Christian Gunawan 334d690687
[hentaicosplays] Add extractor (#1473)
3 years ago
Mike Fährmann 82c32d25af
[500px] update query hashes
3 years ago
Mike Fährmann de14b7ad7a
[slideshare] fix extraction
3 years ago
Mike Fährmann bef3105121
[komikcast] fix extraction
3 years ago
Mike Fährmann 086925e685
[shopify] support omgmiamiswimwear.com (closes #1280)
3 years ago
thatfuckingbird 224b883ff4
[danbooru] add option for extended metadata extraction (#1458)
3 years ago
thatfuckingbird dff03a6605
[booru] add an option to extract notes (only gelbooru for now) (#1457)
3 years ago
Mike Fährmann 78d7ee3ef4
[yuki] remove module for yuki.la
3 years ago
Mike Fährmann 5a98bcec3a
[deviantart] improve folder name matching (fixes #1451)
3 years ago
thatfuckingbird 918b0441fb
[gelbooru] fix tag category extraction (#1455)
3 years ago
Mike Fährmann fe6ce5b8f8
[erome] skip deleted albums (fixes #1447)
4 years ago
Mike Fährmann 457abf0e71
[deviantart] fix pagination for Eclipse results (fixes #1444)
4 years ago
Mike Fährmann dee540050f
[8muses] fix JSON unobfuscation
4 years ago
Mike Fährmann b869b3a9eb
[instagram] fetch media for incomplete GraphSidecar posts
4 years ago
Mike Fährmann b0686d2174
[instagram] update query hashes
4 years ago
Mike Fährmann e8e3717b71
[instagram] add extractor for /tagged posts (#1439)
4 years ago
Mike Fährmann abafe71e04
[exhentai] fix image limit detection (closes #1437)
4 years ago
Mike Fährmann 52a7913abe
[artstation] download /4k/ images (#1422)
4 years ago
Christian Paul 41fbc20020
[webtoons]: Add cookie rstagGDPR_DE=true (#1431)
4 years ago
FollieHiyuki e3b9f88540
Add manganelo extractor (#1415)
4 years ago
Mike Fährmann fd858eed7b
[twitter] add 'user_likes' metadata field for liked tweets
4 years ago
Mike Fährmann 8d124a3766
[twitter] rename variables
4 years ago
Mike Fährmann 105f3c9666
[twitter] add extractor for direct image links (closes #1417)
4 years ago
Mike Fährmann ec3d5d58a8
[vk] improve extractor (#474)
4 years ago
Mike Fährmann ebd142e2a8
[twitter] don't use youtube-dl for cards when videos are disabled
4 years ago
Mike Fährmann d5aad999dc
[tapas] implement login with username & password (#692)
4 years ago
Mike Fährmann e9ec91c811
[exhentai] improve image limits check
4 years ago
Mike Fährmann 387fe415d5
unescape items in text.split_html()
4 years ago
Mike Fährmann 36291176bc
[pinterest] add 'search' extractor (#1411)
4 years ago
Mike Fährmann 058cc47e9b
[bcy] improve pagination
4 years ago
Mike Fährmann ddd48ceee5
update extractor test results
4 years ago
Mike Fährmann 1a540fbe00
[komikcast] fix extraction
4 years ago
Mike Fährmann 5aa30c3669
[tapas] add 'series' and 'episode' extractors (#692)
4 years ago
Mike Fährmann ccfa5a8694
[twitter] better error message when logging in with 2FA (#1409)
4 years ago
Mike Fährmann 214ecf62ce
[deviantart] fix arguments for search/popular results (#1408)
4 years ago
Magnus Boman 522d0a834c
[aryion] Unescape paths too (#1414)
4 years ago
beesdotjson 5ad615f0db
fix PixivFavoriteExtractor regex (#1405)
4 years ago
Mike Fährmann 62cfee4d28
[vk] initial support for albums (#474)
4 years ago
Mike Fährmann 0e601de67b
[sankaku] simplify 'pool' tags (#1388)
4 years ago
Mike Fährmann d085ade9d5
[sankaku] add 'tag_string' metadata field (#1388)
4 years ago
Mike Fährmann 2dffd231b7
[sankaku] add enumeration index for books (#1388)
4 years ago
Mike Fährmann 139fb84108
[deviantart] fix username for 'watch' results (#794)
4 years ago
Mike Fährmann 91c2e15da9
[deviantart] add support for posts from watched users (#794)
4 years ago
Mike Fährmann 03c20d8c8e
[deviantart] update 'watch' URL pattern (#794)
4 years ago
Mike Fährmann 2846235669
[twitter] allow specifying a custom format for user results
4 years ago
Mike Fährmann dc23cfd684
[deviantart] use fallback for /intermediary/ URLs
4 years ago
Mike Fährmann b0438c8f99
Revert "[deviantart] extend 'extra' option"
4 years ago
Mike Fährmann 58b93635ee
[architizer] add 'firm' extractor (#1369)
4 years ago
Mike Fährmann 204523611c
[imgclick] use 'http://' for image URLs
4 years ago
Mike Fährmann 0b55f5ad84
[imgur] fix/improve rate limit handling (#1386)
4 years ago
Mike Fährmann 69ca4e29f1
[deviantart] add 'watch' extractor (#794)
4 years ago
Mike Fährmann fcdda6128c
[mangastream] remove module
4 years ago
Mike Fährmann c677ea19dd
[mangareader] remove module
4 years ago
Mike Fährmann 71523aaab6
[architizer] add 'project' extractor (#1369)
4 years ago
Mike Fährmann 3378b39719
[twitter] implement 'users' option (#1337)
4 years ago
Mike Fährmann 847e9b0ed7
[philomena] support post URLs without '/images/'
4 years ago
Mike Fährmann 466966bf83
[hentaicafe] remove module
4 years ago
Mike Fährmann 97641cd151
[hentainexus] remove module
4 years ago
Mike Fährmann c485d0a956
[philomena] add generalized extractors for philomena sites
4 years ago
Mike Fährmann 6be7df53da
[hentaifox] improve metadata extraction (fixes #1378)
4 years ago
Mike Fährmann 72fe9ac0f3
[gelbooru_v01] support some more boorus by default
4 years ago
tux93 10c279f285
Weasyl: Drop the `&feature=submit` part of the favourite extractor URL (#1374)
4 years ago
Mike Fährmann 4be27ff0fe
[nozomi] support '/index-N.html' URLs (closes #1365)
4 years ago
Mike Fährmann 780bac4c8a
[gelbooru] update video server (fixes #1368)
4 years ago
Mike Fährmann f8441e851a
[hentaifox] improve image extraction (fixes #1366)
4 years ago
Mike Fährmann c7c3fef0bc
[exhentai] support '/tag/' URLs (closes #1363)
4 years ago
Mike Fährmann 90830daf85
[exhentai] improve 'favorites' extraction (closes #1360)
4 years ago
Mike Fährmann 83f465faca
[deviantart] refactor 'extra' (#1356)
4 years ago
Mike Fährmann 5c32a7bf58
[deviantart] allow selecting source for 'extra' (#1356)
4 years ago
Mike Fährmann a677123abb
[instagram] recognize 'reels' as option for 'include' (#1329)
4 years ago
Mike Fährmann 94faf8c85a
add type check before applying 'browser' option (fixes #1358)
4 years ago
Mike Fährmann 7440d1f112
[pixiv] add 'translated-tags' option (closes #1354)
4 years ago
Mike Fährmann 106cdc37c0
[instagram] support '/user/reels/' URLs (closes #1329)
4 years ago
Mike Fährmann 524ebb133e
[instagram] refactor reel handling
4 years ago
Mike Fährmann 9785c551bc
[500px] skip unavailable photos (#1335)
4 years ago
Mike Fährmann 6cfc9613fe
update some code in Extractor constructor
4 years ago
Mike Fährmann f59e63669b
[hentaicafe] add 'search' and 'tag' extractors (#1345)
4 years ago
Mike Fährmann 38e66940c1
[tumblrgallery] simplify
4 years ago
Seonghyeon Cho 665499924d
Support naver webtoon (#1331)
4 years ago
topozorra a9119da4d4
support `tumblrgallery.xyz` (#1298)
4 years ago
Mike Fährmann bff71cde80
implement 'util.unique_squence()'
4 years ago
Mike Fährmann bae874f370
replace 'wait-min/-max' with 'sleep-request'
4 years ago
Mike Fährmann e165e6c265
[wallhaven] add 'collections' extractor (#1351)
4 years ago