Commit Graph

3320 Commits (47cf05c4abf4e950d0896a220ff8558ea5baf79b)

Author SHA1 Message Date
Mike Fährmann f1b142e993
{kemonoparty[ change default 'files' order to attachments,file,inline
3 years ago
Mike Fährmann 0054ad434e
[output] write directly to sys.stdout
3 years ago
Mike Fährmann da14b3fe9f
[output] write download progress indicator to stderr
3 years ago
Mike Fährmann 604d5b8bb2
release version 1.19.3
3 years ago
Mike Fährmann 275543b2d2
update extractor test results
3 years ago
Mike Fährmann e7ea4f2567
[mangoxo] fix metadata extraction
3 years ago
Mike Fährmann e298882acc
[kemonoparty] match URLs with www subdomain
3 years ago
Mike Fährmann addb72e1bb
[reactor] support thatpervert.com (closes #2029)
3 years ago
Mike Fährmann d8d9502e1e
[reactor] inherit from BaseExtractor
3 years ago
Mike Fährmann f4ea216c95
[shopify] support loungeunderwear.com (closes #2053)
3 years ago
Mike Fährmann 93cef78450
[gelbooru] workaround pagination limits
3 years ago
Mike Fährmann f2ae179713
[exhentai] fix extraction for disowned galleries (closes #2055)
3 years ago
Alice 612850438e
[skeb] add 'thumbnails' option (#2047) (#2051)
3 years ago
Mike Fährmann 010d65dcec
extend blacklist/whitelist syntax (#2025)
3 years ago
Mike Fährmann 11a3d96d13
[mangadex] load additional metadata using includes[] directives
3 years ago
Mike Fährmann 19e00f1322
[dynastyscans] provide 'date' as proper datetime object (#2050)
3 years ago
Mike Fährmann af6424f398
allow testing metadata in list elements
3 years ago
Mike Fährmann c67756e187
[kemonoparty] add 'dms' option (#2008)
3 years ago
Mike Fährmann 3842cdcd8f
[formatter] implement 'D' format specifier
3 years ago
Mike Fährmann 3a7a19c7b9
[dynastyscans] add 'manga' extractor (closes #2035)
3 years ago
Mike Fährmann 9bc83af3a6
[kemonoparty] 'postfile' -> 'file' (#1991)
3 years ago
Mike Fährmann 522782c09d
[subscribestar] emit metadata for posts without media (#1569)
3 years ago
Mike Fährmann 1c8aaf9318
[subscribestar] add 'num' enumeration index (closes #2040)
3 years ago
Mike Fährmann d433735750
[kemonoparty] skip duplicate files (#2032, #1991, #1899)
3 years ago
Mike Fährmann d4ec245554
[kemonoparty] implement a 'files' option (#1991)
3 years ago
Mike Fährmann ab8eea1a24
[twitter] fix extractor for direct image links (fixes #2030)
3 years ago
Mike Fährmann 2076d40681
[ytdl] improve error handling (#1680)
3 years ago
Mike Fährmann 8eaedb0bd3
[ytdl] fix some compatibility issues (#1680)
3 years ago
Mike Fährmann 2aaac3c997
[instagram] include user metadata for 'tagged' downloads (#2024)
3 years ago
Mike Fährmann cfa4876848
[philomena] support furbooru.org (closes #1995)
3 years ago
Mike Fährmann 4377f1c284
[twitter] distinguish between fatal & nonfatal errors (#2020)
3 years ago
Mike Fährmann 19403a7fff
[downloader:ytdl] prevent crash in '_progress_hook()' (#1680)
3 years ago
Mike Fährmann 01b28f3674
[ytdl] fix syntax for Python 3.4
3 years ago
Kyle Anthony Williams a14b72be21
[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net (#2005)
3 years ago
Mike Fährmann 6e3658ef52
[kemonoparty] provide 'date' metadata for gumroad (#2007)
3 years ago
Mike Fährmann f4d201f626
[ytdl] fix syntax for Python 3.4
3 years ago
Mike Fährmann 37c9dedee1
[seisoparty] remove module
3 years ago
Mike Fährmann efa178cc91
[ytdl] implement parsing ytdl command-line options (#1680)
3 years ago
Mike Fährmann a881305357
release version 1.19.2
3 years ago
Mike Fährmann 7cb303d745
[redgifs] improve URL extraction
3 years ago
Mike Fährmann 2befed1a96
[redgifs] update search URL pattern (#1984)
3 years ago
Mike Fährmann b315a0ecef
[redgifs] update to API v2 (#1984)
3 years ago
Mike Fährmann f0fc3b0ba1
[kemonoparty] add 'comments' option (#1980)
3 years ago
Mike Fährmann 1fac74b14d
[reddit] prevent crash for galleries with no 'media_metadata'
3 years ago
Mike Fährmann 211de95dd0
update extractor test results
3 years ago
Mike Fährmann 8bea02c38c
[deviantart] fix 'index' values for stashed deviations
3 years ago
Mike Fährmann dd88a7d980
{cyberdrop] restore video extraction (fixes #1993)
3 years ago
Mike Fährmann fa5646eadc
[mangoxo] fix login and extraction
3 years ago
Mike Fährmann 4c49174579
[mangakakalot] update domain and fix extraction
3 years ago
YongChan Cho 14852f7050
[hitomi] fix image path (#1988)
3 years ago
Mike Fährmann 46e17c5e61
support accessing the current local datetime in format strings
3 years ago
Mike Fährmann dad2875a3e
fix calculating retry sleep times (fixes #1990)
3 years ago
Mike Fährmann 9156e90f1f
[twitter] add 'pinned' option
3 years ago
Mike Fährmann 06b414c9a3
[redgifs] 'gfyId' -> 'id' (#1984)
3 years ago
Ryu juheon d4614e5ba4
[hitomi] fix image URLs (#1982)
3 years ago
Mike Fährmann 6434ccf9e8
[redgifs] split from 'gfycat' (#1984)
3 years ago
Mike Fährmann 38193dba46
support accessing environment variables in format strings (#1968)
3 years ago
Mike Fährmann e4696b40ba
[instagram] update query hashes
3 years ago
Alice bfd7401b1e
[skeb] add 'user' and 'post' extractors (#1031) (#1971)
3 years ago
Ryu juheon 6b6d92d51c
[hitomi]: fix image URLs (#1975)
3 years ago
Mike Fährmann dcb201ff19
[gfycat] show warning when there are no available formats
3 years ago
Mike Fährmann e436a2607b
[gfycat] consistent 'userName' values for 'user' downloads (#1962)
3 years ago
Mike Fährmann ba9579c504
release version 1.19.1
3 years ago
Mike Fährmann f1487a3cfa
[kemonoparty:discord] improve 'inline' extraction (#1940)
3 years ago
Mike Fährmann 02a247f4e5
[deviantart] full resolution for non-downloadable images (#293)
3 years ago
Mike Fährmann a7ddb5f5fa
[deviantart] update 'search' argument handling (fixes #1911)
3 years ago
Mike Fährmann c19e762fdf
[vk] add 'album' extractor (#474, fixes #1952)
3 years ago
Mike Fährmann 8bb442f20d
[redgifs][gfycat] provide fallback URLs (fixes #1962)
3 years ago
Mike Fährmann b6443c576d
[kemonoparty:discord] extract 'inline' files
3 years ago
Mike Fährmann 232ab626a7
[downloader:ytdl] prevent crash in '_progress_hook()'
3 years ago
Mike Fährmann bcbf9bcf36
[kemonoparty] split 'discord' extractor (#1940)
3 years ago
Mike Fährmann db857b40d8
[kemonoparty] improve inline extraction (#1899)
3 years ago
Mike Fährmann 975e0a4fe0
[furaffinity] unquote search queries (#1958)
3 years ago
Mike Fährmann 8d676151b7
[patreon] implement 'files' option (#1935)
3 years ago
Mike Fährmann 6695ef2e10
[patreon] better filenames for 'content' images (#1954)
3 years ago
Mike Fährmann 70005e3275
[kemonoparty:discord] support downloading from a specific channel
3 years ago
Mike Fährmann 003f25931d
[kemonoparty:discord] provide a 'channel_name'
3 years ago
Mike Fährmann 28bdd58e6d
[nhentai] simplify
3 years ago
Mike Fährmann 50098762e3
[nhentai] add 'tag' extractor (closes #1950)
3 years ago
Mike Fährmann fe6ce5495a
[kemonoparty] add 'discord' extractor (#1827, #1940)
3 years ago
Mike Fährmann f2d6b3e6b4
run tests without using 'nose'
3 years ago
Mike Fährmann 918fc9974d
[picarto] add 'gallery' extractor (closes #1931)
3 years ago
Mike Fährmann e33125ad39
[pixiv] add 'sketch' extractor (#1497)
3 years ago
Mike Fährmann e9dc6ff262
[inkbunny] add 'following' extractor (#515)
3 years ago
Mike Fährmann 9c8fc6e7b4
[inkbunny] match "long" URLs for pools and favorites (#1937)
3 years ago
Mike Fährmann f33c2ef73b
[cyberdrop] extract direct download URLs (#1943)
3 years ago
Mike Fährmann b93915c113
[inkbunny] add 'pool' extractor (#1937)
3 years ago
Mike Fährmann 373d3e1c57
[seisoparty] implement login with username & password (#1906)
3 years ago
Mike Fährmann 7c5f62b453
[seisoparty] add 'favorite' extractor (#1906)
3 years ago
Mike Fährmann d93b5474c3
[mangadex] update parameter handling for API requests
3 years ago
Mike Fährmann cd66c3c415
[twitter] add 'size' option (#1881)
3 years ago
Mike Fährmann df8050b81d
[postprocessor:compare] add 'equal' option (#1592)
3 years ago
Mike Fährmann f8410203ef
release version 1.19.0
3 years ago
Mike Fährmann cdd72e1413
[postprocessor:compare] extend 'action' option (#1592)
3 years ago
Mike Fährmann fb98b3fdaf
[redgifs][gfycat] remove webtoken code (fixes #1907)
3 years ago
Mike Fährmann 96215c926e
[mangadex] fix retrieving chapters from 'pornographic' titles
3 years ago
Mike Fährmann da9685609c
[kemonoparty] update file download URLs
3 years ago
Mike Fährmann 783eae6fc5
[hiperdex] fix extraction
3 years ago
Mike Fährmann 28f1c36da2
simplify and adjust download progress indicator (#1519)
3 years ago
Mike Fährmann e0bdacd932
[fappic] add 'image' extractor (closes #1898)
3 years ago
Mike Fährmann c22ff97743
remove 'unit' argument from 'util.format_value()'
3 years ago
Mike Fährmann d0761454b1
implement a download progress indicator (#1519)
3 years ago
Mike Fährmann cad85640de
move 'util.PathFormat' into its own 'path' module
3 years ago
Mike Fährmann 0038a8c1a4
implement a way to specify 'extended' format strings
3 years ago
Mike Fährmann 74145467dd
move 'util.Formatter' into its own 'formatter' module
3 years ago
Mike Fährmann 9377543162
[mastodon] add 'following' extractor (#1891)
3 years ago
Mike Fährmann 2c2932973c
[mastodon] support specifying accounts by ID
3 years ago
Mike Fährmann 94143eb86c
[twitter] add 'quote_by' metadata field (#1481)
3 years ago
Mike Fährmann 1cc73e11aa
add '--write-infojson' command-line option
3 years ago
Mike Fährmann a23f5d45d7
[deviantart] fix bug with fetching premium content (#1879)
3 years ago
Mike Fährmann ada36c2044
[deviantart] update default archive_fmt for single deviations
3 years ago
Mike Fährmann da16eabb82
[twitter] ensure card entries have a 'url' (#1868)
3 years ago
Mike Fährmann e69ee41f25
implement 'page-reverse' option (#1854)
3 years ago
cyberdrop-me c83668c2ff
[CyberDrop] Change directory name format (#1871)
3 years ago
Mike Fährmann e4684c5cb9
[desktopography] simplify (#1740)
3 years ago
Giacomo Rossetto 4a7d7899ff
Implement desktopography extractor (#1740)
3 years ago
Alice 9992ff38da
[fantia] add 'date' metadata field (#1853)
3 years ago
Mike Fährmann fba95c3a9e
[nozomi] preserve case of search tags (fixes #1860)
3 years ago
Mike Fährmann 4b3e309b90
[aryion] update/improve pagination (#1849)
3 years ago
Mike Fährmann 266ed9b62e
[aryion] add 'tag' extractor (closes #1849)
3 years ago
Mike Fährmann 6bbeaac029
[mangadex] fix extraction (fixes #1852)
3 years ago
Mike Fährmann e9bf8d2591
[instagram] update default delay to 6-12 seconds (#1835)
3 years ago
Mike Fährmann c9e6693530
allow specifying a minimum/maximum for 'sleep-*' options (#1835)
3 years ago
Mike Fährmann bd845303ad
implement a way to shorten filenames with east-asian characters
3 years ago
Mike Fährmann 2ff2974353
[common] update default argument handling in Extractor.request()
3 years ago
Mike Fährmann 0fd959a2a7
[twitter] support '/with_replies' URLs (closes #1833)
3 years ago
Mike Fährmann e93360e45d
[reddit] extend subcategory depending on input URL (closes #1836)
3 years ago
Mike Fährmann 7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor (closes #1834)
3 years ago
Mike Fährmann 4ec11af6a4
[kemonoparty] implement login with username & password (#1824)
3 years ago
Mike Fährmann 0e33746fe0
[artstation] use '/album/all' view for user portfolios (#1826)
3 years ago
Mike Fährmann 4f5f9ed1e5
[oauth] fix typo
3 years ago
Mike Fährmann 83bbb628d8
[kemonoparty] add 'favorite' extractor (#1824)
3 years ago
Mike Fährmann 35d75a4071
[erome] send Referer header for file downloads (fixes #1829)
3 years ago
Mike Fährmann 44f572c27f
[deviantart] implement a 'auto-unwatch' option (#1466, #1757)
3 years ago
Mike Fährmann d79bcb6236
allow extractors to register a 'finalize()' method
3 years ago
Mike Fährmann 9158853ff7
release version 1.18.4
3 years ago
Mike Fährmann 47a780942c
update extractor test results
3 years ago
Mike Fährmann eed6ef3de0
[pixiv] fix pixivision title extraction
3 years ago
Mike Fährmann 7645cdfb88
[inkbunny] fix extraction (closes #1816)
3 years ago
Mike Fährmann 3e36543c98
[nhentai] add 'favorite' extractor (#1814)
3 years ago
Mike Fährmann 656358ea92
[nhentai] use API endpoint for gallery data
3 years ago
Mike Fährmann 8cd7759682
[reddit] cleanup ReddeitAPI.__init__ (#1813)
3 years ago
Mike Fährmann 0a94fe5774
[reddit] delay RedditAPI initialization (#1813)
3 years ago
Mike Fährmann 57854624a1
[exhentai] improve image limits check (#1808)
3 years ago
Mike Fährmann 96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
3 years ago
Mike Fährmann e75f2de9da
[deviantart] add 'comments' option (#1800)
3 years ago
Mike Fährmann 6ce16c6d31
[deviantart] add 'tag' extractor (closes #1803)
3 years ago
Mike Fährmann 4e9f8fe395
[shopify] support windsorstore.com (#1793)
3 years ago
Mike Fährmann 95157e0f4b
[shopify] use API for product listings (#1793)
3 years ago
Mike Fährmann 292fffc83c
add 'j' format string conversion
3 years ago
Mike Fährmann 6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
3 years ago
Mike Fährmann ecc8da4704
[deviantart] implement a 'watch' option (#1466, #1757)
3 years ago
Mike Fährmann a4f249c22e
[deviantart] prevent exception on empty videos (fixes #1796)
3 years ago
Mike Fährmann ae78d95a5f
[twitter] fix issue when filtering quote tweets (#1792)
3 years ago
Mike Fährmann d3eab417ed
implement a 'path-strip' option
3 years ago
Mike Fährmann 72c0cd30c7
do not return with a nonzero exit status when no results found
3 years ago
Mike Fährmann 6b229ac829
[furaffinity] expand URL pattern for searches (closes #1780)
3 years ago
Mike Fährmann 0817f468ef
[twitter] expand t.co links in user descriptions (#1532, #1787)
3 years ago
Mike Fährmann 7c0ae88185
[twitter] add 'url' to user objects (#1532, #1787)
3 years ago
Mike Fährmann 5919dc5b5a
[twitter] slightly improve '_transform_user()'
3 years ago
Mike Fährmann c04f7ab139
[foolfuuka] add 'gallery' extractor (#1785)
3 years ago
Mike Fährmann ddd175de77
[mangadex] prevent KeyError for manga without English title
3 years ago
Mike Fährmann 20ee091289
[429chan] add 'thread' and 'board' extractors (closes #1773)
3 years ago
Mike Fährmann 6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
3 years ago
Mike Fährmann 51eb50749f
[foolslide] remove entry for kobato.hologfx.com
3 years ago
Mike Fährmann 4718f9c5dd
[oauth] use defaults when config values are set to None/null
3 years ago
James C. Wise 1f02878351
[Deviantart] [#1776] Remove the "you need session cookies to download mature scraps" warning (#1777)
3 years ago
Mike Fährmann bb6a130942
automatically set required DDoS-GUARD cookies (#1779)
3 years ago
Mike Fährmann bd08ee2859
remove most 'yield Message.Version' statements
3 years ago
Mike Fährmann bdfdabf498
show warning if extractor doesn't yield any results (#1759)
3 years ago
Mike Fährmann d320ee6251
implement a 'fallback' option (closes #1770)
3 years ago
Mike Fährmann c866fcba48
[twitter] fix 'logout' (#1719)
3 years ago
Mike Fährmann 9cb5ea5eda
update default User-Agent headers
3 years ago
Mike Fährmann 1e0f59d902
release version 1.18.3
3 years ago
Mike Fährmann 52984f7e22
[twitter] add option to log out when blocked (#1719)
3 years ago
Mike Fährmann ed4b3c48cb
fix flake8 and other tests
3 years ago
enormous-muscles 975e1ac6e2
Add Wikieat extractor (#1699)
3 years ago
Nyasume fa6af46756
Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701)
3 years ago
Ryu JuHeon 9429eaa0a3
[hitomi]: fix image URLs (#1765)
3 years ago
Mike Fährmann c34dbc86bb
[kemonoparty] update file server domain (#1764)
3 years ago
Mike Fährmann e5a93e113f
[twitter] extend 'replies' option (#1254)
3 years ago
Mike Fährmann f9096584ab
[behance] fix 'collection' extraction
3 years ago
Mike Fährmann 229498b8aa
[twitter] warn about suspended accounts etc (closes #1759)
3 years ago
Mike Fährmann a5de2244d4
[furaffinity] fix using 'category-tranfer' (#1274)
3 years ago
Mike Fährmann cadfad4eea
[danbooru] add 'external' option (closes #1747)
3 years ago
Mike Fährmann 5b1c62bfa9
[furaffinity] add 'external' option (closes #1492)
3 years ago
Mike Fährmann b5b1cf22b7
[downloader:http] reorder HTTP header sources
3 years ago
Mike Fährmann 5d5ab669fa
[instagram] use custom User-Agent header for video downloads
3 years ago
Mike Fährmann 7b029dfe85
[instagram] increase default delay between HTTP requests to 8s
3 years ago
Mike Fährmann 5eca3781be
[kemonoparty] fix username extraction (#1750)
3 years ago
Mike Fährmann fe970fc87f
[vk] prevent exception for empty/private profiles (fixes 1742)
3 years ago
Mike Fährmann ac91a84543
[bbc] provide fallback URLs (#1706)
3 years ago
Mike Fährmann a316e44f8e
[bbc] add 'width' option (#1706)
3 years ago
Mike Fährmann c37c2818fb
[nsfwalbum] retry all requests when extracting image URLs
3 years ago
Mike Fährmann 220cfe244e
[deviantart] get original files for GIF previews (#1731)
3 years ago
Mike Fährmann 7a0da4f93f
[newgrounds] add 'format' option (closes #1729)
3 years ago
Mike Fährmann 223a4e79cd
[newgrounds] fix using 'category-tranfer' (#1274)
3 years ago
Mike Fährmann 4e95cef6d2
[nsfwalbum] retry backend requests (fixes #1733)
3 years ago
Mike Fährmann 6c11105587
[bbc] improve image dimensions (#1706)
3 years ago
Mike Fährmann 57c1a86082
[bbc] support multi-page gallery listings (closes #1730)
3 years ago