Commit Graph

3194 Commits (882c614281f35d22c9158655427b169d65d79127)

Author SHA1 Message Date
Mike Fährmann e93360e45d
[reddit] extend subcategory depending on input URL (closes #1836)
3 years ago
Mike Fährmann 7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor (closes #1834)
3 years ago
Mike Fährmann 4ec11af6a4
[kemonoparty] implement login with username & password (#1824)
3 years ago
Mike Fährmann 0e33746fe0
[artstation] use '/album/all' view for user portfolios (#1826)
3 years ago
Mike Fährmann 4f5f9ed1e5
[oauth] fix typo
3 years ago
Mike Fährmann 83bbb628d8
[kemonoparty] add 'favorite' extractor (#1824)
3 years ago
Mike Fährmann 35d75a4071
[erome] send Referer header for file downloads (fixes #1829)
3 years ago
Mike Fährmann 44f572c27f
[deviantart] implement a 'auto-unwatch' option (#1466, #1757)
3 years ago
Mike Fährmann d79bcb6236
allow extractors to register a 'finalize()' method
3 years ago
Mike Fährmann 9158853ff7
release version 1.18.4
3 years ago
Mike Fährmann 47a780942c
update extractor test results
3 years ago
Mike Fährmann eed6ef3de0
[pixiv] fix pixivision title extraction
3 years ago
Mike Fährmann 7645cdfb88
[inkbunny] fix extraction (closes #1816)
3 years ago
Mike Fährmann 3e36543c98
[nhentai] add 'favorite' extractor (#1814)
3 years ago
Mike Fährmann 656358ea92
[nhentai] use API endpoint for gallery data
3 years ago
Mike Fährmann 8cd7759682
[reddit] cleanup ReddeitAPI.__init__ (#1813)
3 years ago
Mike Fährmann 0a94fe5774
[reddit] delay RedditAPI initialization (#1813)
3 years ago
Mike Fährmann 57854624a1
[exhentai] improve image limits check (#1808)
3 years ago
Mike Fährmann 96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
3 years ago
Mike Fährmann e75f2de9da
[deviantart] add 'comments' option (#1800)
3 years ago
Mike Fährmann 6ce16c6d31
[deviantart] add 'tag' extractor (closes #1803)
3 years ago
Mike Fährmann 4e9f8fe395
[shopify] support windsorstore.com (#1793)
3 years ago
Mike Fährmann 95157e0f4b
[shopify] use API for product listings (#1793)
3 years ago
Mike Fährmann 292fffc83c
add 'j' format string conversion
3 years ago
Mike Fährmann 6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
3 years ago
Mike Fährmann ecc8da4704
[deviantart] implement a 'watch' option (#1466, #1757)
3 years ago
Mike Fährmann a4f249c22e
[deviantart] prevent exception on empty videos (fixes #1796)
3 years ago
Mike Fährmann ae78d95a5f
[twitter] fix issue when filtering quote tweets (#1792)
3 years ago
Mike Fährmann d3eab417ed
implement a 'path-strip' option
3 years ago
Mike Fährmann 72c0cd30c7
do not return with a nonzero exit status when no results found
3 years ago
Mike Fährmann 6b229ac829
[furaffinity] expand URL pattern for searches (closes #1780)
3 years ago
Mike Fährmann 0817f468ef
[twitter] expand t.co links in user descriptions (#1532, #1787)
3 years ago
Mike Fährmann 7c0ae88185
[twitter] add 'url' to user objects (#1532, #1787)
3 years ago
Mike Fährmann 5919dc5b5a
[twitter] slightly improve '_transform_user()'
3 years ago
Mike Fährmann c04f7ab139
[foolfuuka] add 'gallery' extractor (#1785)
3 years ago
Mike Fährmann ddd175de77
[mangadex] prevent KeyError for manga without English title
3 years ago
Mike Fährmann 20ee091289
[429chan] add 'thread' and 'board' extractors (closes #1773)
3 years ago
Mike Fährmann 6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
3 years ago
Mike Fährmann 51eb50749f
[foolslide] remove entry for kobato.hologfx.com
3 years ago
Mike Fährmann 4718f9c5dd
[oauth] use defaults when config values are set to None/null
3 years ago
James C. Wise 1f02878351
[Deviantart] [#1776] Remove the "you need session cookies to download mature scraps" warning (#1777)
3 years ago
Mike Fährmann bb6a130942
automatically set required DDoS-GUARD cookies (#1779)
3 years ago
Mike Fährmann bd08ee2859
remove most 'yield Message.Version' statements
3 years ago
Mike Fährmann bdfdabf498
show warning if extractor doesn't yield any results (#1759)
3 years ago
Mike Fährmann d320ee6251
implement a 'fallback' option (closes #1770)
3 years ago
Mike Fährmann c866fcba48
[twitter] fix 'logout' (#1719)
3 years ago
Mike Fährmann 9cb5ea5eda
update default User-Agent headers
3 years ago
Mike Fährmann 1e0f59d902
release version 1.18.3
3 years ago
Mike Fährmann 52984f7e22
[twitter] add option to log out when blocked (#1719)
3 years ago
Mike Fährmann ed4b3c48cb
fix flake8 and other tests
3 years ago
enormous-muscles 975e1ac6e2
Add Wikieat extractor (#1699)
3 years ago
Nyasume fa6af46756
Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701)
3 years ago
Ryu JuHeon 9429eaa0a3
[hitomi]: fix image URLs (#1765)
3 years ago
Mike Fährmann c34dbc86bb
[kemonoparty] update file server domain (#1764)
3 years ago
Mike Fährmann e5a93e113f
[twitter] extend 'replies' option (#1254)
3 years ago
Mike Fährmann f9096584ab
[behance] fix 'collection' extraction
3 years ago
Mike Fährmann 229498b8aa
[twitter] warn about suspended accounts etc (closes #1759)
3 years ago
Mike Fährmann a5de2244d4
[furaffinity] fix using 'category-tranfer' (#1274)
3 years ago
Mike Fährmann cadfad4eea
[danbooru] add 'external' option (closes #1747)
3 years ago
Mike Fährmann 5b1c62bfa9
[furaffinity] add 'external' option (closes #1492)
3 years ago
Mike Fährmann b5b1cf22b7
[downloader:http] reorder HTTP header sources
3 years ago
Mike Fährmann 5d5ab669fa
[instagram] use custom User-Agent header for video downloads
3 years ago
Mike Fährmann 7b029dfe85
[instagram] increase default delay between HTTP requests to 8s
3 years ago
Mike Fährmann 5eca3781be
[kemonoparty] fix username extraction (#1750)
3 years ago
Mike Fährmann fe970fc87f
[vk] prevent exception for empty/private profiles (fixes 1742)
3 years ago
Mike Fährmann ac91a84543
[bbc] provide fallback URLs (#1706)
3 years ago
Mike Fährmann a316e44f8e
[bbc] add 'width' option (#1706)
3 years ago
Mike Fährmann c37c2818fb
[nsfwalbum] retry all requests when extracting image URLs
3 years ago
Mike Fährmann 220cfe244e
[deviantart] get original files for GIF previews (#1731)
3 years ago
Mike Fährmann 7a0da4f93f
[newgrounds] add 'format' option (closes #1729)
3 years ago
Mike Fährmann 223a4e79cd
[newgrounds] fix using 'category-tranfer' (#1274)
3 years ago
Mike Fährmann 4e95cef6d2
[nsfwalbum] retry backend requests (fixes #1733)
3 years ago
Mike Fährmann 6c11105587
[bbc] improve image dimensions (#1706)
3 years ago
Mike Fährmann 57c1a86082
[bbc] support multi-page gallery listings (closes #1730)
3 years ago
Mike Fährmann 2792ed6e4b
implement 'util.format_value()'
3 years ago
Mike Fährmann 552032d4fb
release version 1.18.2
3 years ago
Mike Fährmann 486474800f
[kemonoparty] skip duplicated patreon files (closes #1689)
3 years ago
Mike Fährmann da7297c0b9
[comicvine] add extractor (closes #1712)
3 years ago
Mike Fährmann e4788fa663
[bbc] add 'gallery' and 'programme' extractors (closes #1706)
3 years ago
Mike Fährmann 13d4045a8a
add 'archive-prefix' option (#1711)
3 years ago
Mike Fährmann c3b5c88b04
update extractor test results
3 years ago
Mike Fährmann 9e42cd58ea
replace ChainPredicate class with 'functools.partial'
3 years ago
Mike Fährmann 1b2f9050fb
rename all instances of 'kwds' to 'kwdict'
3 years ago
Mike Fährmann 3868ec02d1
[pururin] update domain and fix extraction
3 years ago
Mike Fährmann b89a44090f
[naverwebtoon] fix comic extraction
3 years ago
Mike Fährmann 4048eabeab
allow 'extractor.modules' to be a string
3 years ago
Mike Fährmann c8e678a5b4
[instagram] fix extraction of '/explore/tags/' posts
3 years ago
Mike Fährmann a6a51f207d
[moebooru] fix 'tags' ending with a '+' when logged in (#1702)
3 years ago
Mike Fährmann f5b097165e
[ytdl] transfer YoutubeDL objects to downloader (#1680)
3 years ago
Mike Fährmann 06e69ea79a
[ytdl] actually set options for YoutubeDL objects (#1680)
3 years ago
Mike Fährmann fc19010808
[downloader:ytdl] fix 'outtmpl' setting for yt_dlp (#1680)
3 years ago
Mike Fährmann dfe1f490e9
[mangadex] use custom User-Agent header (#1535)
3 years ago
Mike Fährmann 36a2aff363
[vk] improve metadata extraction and URL pattern (fixes #1691)
3 years ago
Mike Fährmann b9783403d9
add 'url-metadata' option (#1659, #1073)
3 years ago
Mike Fährmann e622e004f0
[ytdl] improve module imports (#1680)
3 years ago
Mike Fährmann e95f99882f
extend 'parent-metadata' functionality (#1687, #1651, #1364)
3 years ago
Mike Fährmann 193401ce3b
[ytdl] "fix" cookie transfer between session and ytdl (#1680)
3 years ago
Mike Fährmann 9a849cdf61
[ytdl] allow setting 'module' for subcategories (#1680)
3 years ago
Mike Fährmann dff0da60f9
[ytdl] add 'generic' option (#1680)
3 years ago
Mike Fährmann d3da96142a
[ytdl] support cookies + username&password (#1680)
3 years ago
Mike Fährmann 36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
3 years ago
Mike Fährmann 64240c8d42
[imagevenue] fix extraction
3 years ago
Mike Fährmann d287d2eb88
[kemonoparty] parse 'o' query parameters (#1674)
3 years ago
Mike Fährmann 8b036778e3
[kemonoparty] add 'max-posts' option (#1674)
3 years ago
Mike Fährmann 5612ca31c2
[hitomi] fix image URLs (closes #1679)
3 years ago
Mike Fährmann 8ecca3af58
[pixiv] add extractor for 'pixivision' articles (#1672)
3 years ago
Mike Fährmann 312a28e78a
[mastodon] add 'replies' option (#1669)
3 years ago
Mike Fährmann 513c491cea
[mastodon] reset 'params' after first pagination iteration
3 years ago
Mike Fährmann a1f5b78039
[mastodon] add 'reblogs' option (#1669)
3 years ago
Mike Fährmann 317ecc8180
use HTML tables in docs/formatting.md
3 years ago
Mike Fährmann 5f1b13d1a5
release version 1.18.1
3 years ago
Mike Fährmann 21c2da454f
update extractor test results
3 years ago
Mike Fährmann 7f591c78cb
[mangafox] cleanup
3 years ago
FollieHiyuki 4763bc1e4e
Add MangaExtractor for mangafox (#1633)
3 years ago
Mike Fährmann b519bf567c
[hiperdex] use domain from input URL
3 years ago
Mike Fährmann 93d356712c
[mastodon] implement 'text-posts' option (#1569)
3 years ago
Mike Fährmann 414bdc95a3
[twitter] set 'retweet_id' for original retweets (#1481)
3 years ago
Mike Fährmann 5323c1c73a
[twitter] ensure guest tokens are returned as string (#1665)
3 years ago
Mike Fährmann 9ee45f3617
[kemonoparty] warn about missing DDoS-GUARD cookies
3 years ago
Mike Fährmann 344aab3fb7
[seisoparty] warn about missing DDoS-GUARD cookies
3 years ago
Mike Fährmann 035562bd11
[twitter] remove old-style URLs from image fallback lists
3 years ago
Mike Fährmann daf821b8b6
[seisoparty] use user names instead of IDs by default (#1635)
3 years ago
Mike Fährmann e4db1bad14
[seisoparty] also extract files hosted on 'cdn-2' servers (#1635)
3 years ago
Mike Fährmann 267bbf5996
[mangasee] add 'chapter' and 'manga' extractors
3 years ago
Mike Fährmann fad4918208
[deviantart] use UUIDs in internal folder/collection URLs
3 years ago
Mike Fährmann 64986f9435
fix depth counter in UrlJob
3 years ago
Mike Fährmann 0179581340
add 'T' format string conversion (#1646)
3 years ago
Mike Fährmann f74cf52e2b
[seisoparty] add 'user' and 'post' extractors (#1635)
3 years ago
Mike Fährmann 759735fb02
[kemonoparty] fix 'username' extraction (fixes #1652)
3 years ago
Mike Fährmann befe635022
cache parsed Formatter functions
3 years ago
Mike Fährmann a416e54765
[directlink] manually encode Referer URLs (fixes #1647)
3 years ago
Mike Fährmann 8bdeb2a6dd
[webtoons] match arbitrary language codes (closes #1643)
3 years ago
Mike Fährmann 79b7ee2712
use 'functools.partial' in '_build_cleanfunc' when possible
3 years ago
Mike Fährmann ceaf7fd989
optimize 'base-directory' initialization and usage
3 years ago
Mike Fährmann 2ca011dfa8
add 'kwdict' argument to PathFormat.build_filename()
3 years ago
Mike Fährmann fd00d47116
implement conditional directories (#1394)
3 years ago
Mike Fährmann ee1064a2b2
release version 1.18.0
3 years ago
Mike Fährmann 4adc44df69
[furaffinity] improve metadata extraction (fixes #1630)
3 years ago
Mike Fährmann e98fa01c44
[hitomi] update image URL code (fixes #1637)
3 years ago
Mike Fährmann e9ab97396f
[kemonoparty] update default filenames and archive IDs (#1514)
3 years ago
Mike Fährmann fb4b4725ba
[hiperdex] match 'hiperdex2.com' URLs
3 years ago
Mike Fährmann 95bc1139e0
[instagram] update query hashes
3 years ago
Mike Fährmann 23018a46f6
[instagram] fix login (fixes #1631)
3 years ago
Mike Fährmann cac0110d8b
[redgifs] update API server address (fixes #1632)
3 years ago
Mike Fährmann 0d2961ae81
[500px] remove last query hash entry
3 years ago
Mike Fährmann 7273cf8536
[pixiv] support fetching privately followed users (fixes #1628)
3 years ago
Mike Fährmann e60962f7e5
[philomena] improve tag escapes handling (fixes #1629)
3 years ago
Mike Fährmann d8908ca577
[unsplash] update collections URL pattern (fixes #1627)
3 years ago
Mike Fährmann 9ed13703cc
[sankaku] handle empty tags (fixes #1617)
3 years ago
Mike Fährmann b56e245094
[500px] update GraphQL queries
3 years ago
Mike Fährmann e9993451c3
remove Python version checks
3 years ago
Mike Fährmann 40eb8025cc
require an argument for --clear-cache
3 years ago
Mike Fährmann a751afdfb3
[twitter] change some defaults
3 years ago
Mike Fährmann 4e4ca3c330
[deviantart] pin API version (#1611)
3 years ago
Mike Fährmann d09bc5bd34
[subscribestar] improve attachment filenames (#1609)
3 years ago
Mike Fährmann 2986bf63bf
[mangafox] update URL pattern (fixes #1608)
3 years ago
Mike Fährmann 53dab5c289
[mangadex] revert chapter handling (#1535)
3 years ago
Mike Fährmann def0148582
restructure code in PathFormat constructor
3 years ago
Mike Fährmann 84d2e64024
combine conditional filenames into `filename` option (#1394)
3 years ago
Mike Fährmann 1197ee2c20
[mangadex] add extractor for a user's followed feed (#1535)
3 years ago
Mike Fährmann 07c8adbd8b
[mangadex] implement login with username & password (#1535)
3 years ago
Mike Fährmann b93cbe6720
[postprocessor:zip] run 'finalize()' regardless of 'filter' (#1460)
3 years ago
Mike Fährmann 3e332eaf53
[mangadex] update to API v5 (#1535)
3 years ago
Mike Fährmann ff8d0d7280
[postprocessor:metadata] ensure reliable tags order (fixes #1598)
3 years ago
Mike Fährmann 04f4f9badb
[oauth] prevent exceptions when reporting errors (#1603)
3 years ago
Mike Fährmann dfe1e09df0
add '-T/--terminate' command-line option (#1399)
3 years ago
Mike Fährmann 6ecb710a7f
add '-P/--postprocessor' command-line option
3 years ago
Mike Fährmann 83fc4c1098
update post processor config capabilities
3 years ago
Mike Fährmann 4a747a31a3
[postprocessor:metadata] handle dicts in mode;tags (fixes #1598)
3 years ago
Mike Fährmann a3bf878329
[idolcomplex] improve and fix pagination (#1601)
3 years ago
Mike Fährmann 3cbbefd4ed
support 'filter' option for post processors (#1460)
3 years ago
Mike Fährmann 4cf40434d7
initial support for conditional filenames (#1394)
3 years ago
Mike Fährmann 0abad8bc12
implement 'compile_expression()'
3 years ago
Mike Fährmann e39c4633ba
[cyberdrop] b64decode -> a2b_base64
3 years ago
Mike Fährmann 407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595)
3 years ago
Mike Fährmann 78f89d2e61
[idolcomplex] fix pagination (closes #1594)
3 years ago
Mike Fährmann f14a36cfc9
release version 1.17.5
3 years ago
Mike Fährmann 52052a0e1a
[manganelo] update domain to 'manganato.com'
3 years ago
Mike Fährmann c80b18a477
[weibo] extend 'retweets' option (closes #1542)
3 years ago
Mike Fährmann c0fa5058da
[kemonoparty] actually add a 'type' metadata field (#1556)
3 years ago
Mike Fährmann bb50e85795
[postprocessor:ugoira] optimize writing ffconcat files
3 years ago
Mike Fährmann 5c18db5fab
[postprocessor:ugoira] use 'concat' demuxer by default (#1550)
3 years ago
Mike Fährmann 19a11fa11d
[postprocessor:ugoira] use frame extension from filenames (#1550)
3 years ago
Mike Fährmann 74d97e6c6b
[postprocessor:ugoira] add 'repeat-last-frame' option (#1550)
3 years ago
Mike Fährmann be9547a5f3
[postprocessor:ugoira] use 'image2' demuxer (#1550)
3 years ago
thatfuckingbird 264beb8556
recognize v2.mangapark URLs (#1578)
3 years ago
thatfuckingbird e6811c7450
[pixiv] implement 'max-posts' option (#1558)
3 years ago
Mike Fährmann 8a909e478d
[imagebam] fix extraction of NSFW images (#1534)
3 years ago
Mike Fährmann b5affc62aa
[twitter] rename 'text-only' to 'text-tweets' (#570)
3 years ago
Mike Fährmann 724ca61f36
[twitter] add 'text-only' option (#570)
3 years ago
Mike Fährmann 8fd8126117
fix ISO 639-1 code for Japanese
3 years ago
Mike Fährmann 2c60c7d798
[reactor] skip deleted/empty posts
3 years ago
Mike Fährmann 532ac79fb0
update extractor test results
3 years ago
Mike Fährmann d7bc4a2b8b
[500px] update query hashes
3 years ago
Mike Fährmann 0f35aca728
[aryion] minor code updates
3 years ago
Mike Fährmann 2eb46452ad
[aryion] update 'needle' to not skip text posts (fixes #1568)
3 years ago
Mike Fährmann adf4d661b3
use '_extractor' info in UrlJobs
3 years ago
Mike Fährmann 4fc9668922
[imgur] update URL patterns (#1561)
3 years ago
Mike Fährmann 1eabfa5c7a
[pillowfort] implement login with username & password (#846)
3 years ago
Mike Fährmann 24dd10ac3c
[patreon] extract user defined 'tags' (#1539, closes #1540)
3 years ago