44f572c27f
[deviantart] implement a 'auto-unwatch' option ( #1466 , #1757 )
3 years ago
d79bcb6236
allow extractors to register a 'finalize()' method
3 years ago
9158853ff7
release version 1.18.4
3 years ago
47a780942c
update extractor test results
3 years ago
eed6ef3de0
[pixiv] fix pixivision title extraction
3 years ago
7645cdfb88
[inkbunny] fix extraction ( closes #1816 )
...
'digitalsales', 'forsale', and 'printsales'
are no longer included in the data returned from the API.
3 years ago
3e36543c98
[nhentai] add 'favorite' extractor ( #1814 )
3 years ago
656358ea92
[nhentai] use API endpoint for gallery data
3 years ago
8cd7759682
[reddit] cleanup ReddeitAPI.__init__ ( #1813 )
...
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
3 years ago
0a94fe5774
[reddit] delay RedditAPI initialization ( #1813 )
...
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
3 years ago
57854624a1
[exhentai] improve image limits check ( #1808 )
...
Check for a 'text/html' Content-Type instead of the very specific
137 bytes Content-Length, which might change depending on compression
or other factors.
3 years ago
96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
...
(#1466 , #1757 )
Similar reason as in e05a96db
3 years ago
e75f2de9da
[deviantart] add 'comments' option ( #1800 )
3 years ago
6ce16c6d31
[deviantart] add 'tag' extractor ( closes #1803 )
3 years ago
4e9f8fe395
[shopify] support windsorstore.com ( #1793 )
3 years ago
95157e0f4b
[shopify] use API for product listings ( #1793 )
3 years ago
292fffc83c
add 'j' format string conversion
...
to convert to a JSON formatted string
3 years ago
6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
...
(#1532 , #1787 )
3 years ago
ecc8da4704
[deviantart] implement a 'watch' option ( #1466 , #1757 )
3 years ago
a4f249c22e
[deviantart] prevent exception on empty videos ( fixes #1796 )
3 years ago
ae78d95a5f
[twitter] fix issue when filtering quote tweets ( #1792 )
...
When a user quotes his own Tweet and that Tweet gets filtered by
'"quoted": false', it could also get filtered when it appeared later
as regular Tweet.
3 years ago
d3eab417ed
implement a 'path-strip' option
3 years ago
72c0cd30c7
do not return with a nonzero exit status when no results found
...
also change loglevel from 'warning' to 'info'
(#1789 )
3 years ago
6b229ac829
[furaffinity] expand URL pattern for searches ( closes #1780 )
3 years ago
0817f468ef
[twitter] expand t.co links in user descriptions ( #1532 , #1787 )
3 years ago
7c0ae88185
[twitter] add 'url' to user objects ( #1532 , #1787 )
3 years ago
5919dc5b5a
[twitter] slightly improve '_transform_user()'
3 years ago
c04f7ab139
[foolfuuka] add 'gallery' extractor ( #1785 )
3 years ago
ddd175de77
[mangadex] prevent KeyError for manga without English title
3 years ago
20ee091289
[429chan] add 'thread' and 'board' extractors ( closes #1773 )
3 years ago
6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
...
prevents duplicate logging messages for nonexistent users
(#1759 )
3 years ago
51eb50749f
[foolslide] remove entry for kobato.hologfx.com
3 years ago
4718f9c5dd
[oauth] use defaults when config values are set to None/null
...
(fixes #1778 )
3 years ago
1f02878351
[Deviantart] [ #1776 ] Remove the "you need session cookies to download mature scraps" warning ( #1777 )
3 years ago
bb6a130942
automatically set required DDoS-GUARD cookies ( #1779 )
...
for kemono.party and seiso.party
3 years ago
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
3 years ago
bdfdabf498
show warning if extractor doesn't yield any results ( #1759 )
3 years ago
d320ee6251
implement a 'fallback' option ( closes #1770 )
3 years ago
c866fcba48
[twitter] fix 'logout' ( #1719 )
...
delete 'auth_token' cookie and cookies.txt path
3 years ago
9cb5ea5eda
update default User-Agent headers
3 years ago
1e0f59d902
release version 1.18.3
3 years ago
52984f7e22
[twitter] add option to log out when blocked ( #1719 )
3 years ago
ed4b3c48cb
fix flake8 and other tests
3 years ago
975e1ac6e2
Add Wikieat extractor ( #1699 )
...
* Add Wikieat extractor
* Add Wikieat extractor to extractor list
3 years ago
fa6af46756
Added ability to download GIFs instead of mp4 from Luscious and Reactor ( #1701 )
3 years ago
9429eaa0a3
[hitomi]: fix image URLs ( #1765 )
3 years ago
c34dbc86bb
[kemonoparty] update file server domain ( #1764 )
3 years ago
e5a93e113f
[twitter] extend 'replies' option ( #1254 )
...
Allow setting 'replies to '"self"' to only download from self-replies.
3 years ago
f9096584ab
[behance] fix 'collection' extraction
3 years ago
229498b8aa
[twitter] warn about suspended accounts etc ( closes #1759 )
3 years ago
a5de2244d4
[furaffinity] fix using 'category-tranfer' ( #1274 )
3 years ago
cadfad4eea
[danbooru] add 'external' option ( closes #1747 )
3 years ago
5b1c62bfa9
[furaffinity] add 'external' option ( closes #1492 )
3 years ago
b5b1cf22b7
[downloader:http] reorder HTTP header sources
...
so that any header can be overwritten by a user, except Range
3 years ago
5d5ab669fa
[instagram] use custom User-Agent header for video downloads
...
(#1682 , #1623 , #1580 )
3 years ago
7b029dfe85
[instagram] increase default delay between HTTP requests to 8s
...
(closes #1732 )
3 years ago
5eca3781be
[kemonoparty] fix username extraction ( #1750 )
3 years ago
fe970fc87f
[vk] prevent exception for empty/private profiles (fixes 1742)
3 years ago
ac91a84543
[bbc] provide fallback URLs ( #1706 )
3 years ago
a316e44f8e
[bbc] add 'width' option ( #1706 )
3 years ago
c37c2818fb
[nsfwalbum] retry all requests when extracting image URLs
...
(#1733 , fixes #1271 )
3 years ago
220cfe244e
[deviantart] get original files for GIF previews ( #1731 )
3 years ago
7a0da4f93f
[newgrounds] add 'format' option ( closes #1729 )
3 years ago
223a4e79cd
[newgrounds] fix using 'category-tranfer' ( #1274 )
3 years ago
4e95cef6d2
[nsfwalbum] retry backend requests ( fixes #1733 )
3 years ago
6c11105587
[bbc] improve image dimensions ( #1706 )
...
download the 1920xN versions instead of 976x549
3 years ago
57c1a86082
[bbc] support multi-page gallery listings ( closes #1730 )
3 years ago
2792ed6e4b
implement 'util.format_value()'
3 years ago
552032d4fb
release version 1.18.2
3 years ago
486474800f
[kemonoparty] skip duplicated patreon files ( closes #1689 )
...
this behavior can be disabled with the 'patreon-skip-file' option
3 years ago
da7297c0b9
[comicvine] add extractor ( closes #1712 )
3 years ago
e4788fa663
[bbc] add 'gallery' and 'programme' extractors ( closes #1706 )
3 years ago
13d4045a8a
add 'archive-prefix' option ( #1711 )
3 years ago
c3b5c88b04
update extractor test results
3 years ago
9e42cd58ea
replace ChainPredicate class with 'functools.partial'
3 years ago
1b2f9050fb
rename all instances of 'kwds' to 'kwdict'
3 years ago
3868ec02d1
[pururin] update domain and fix extraction
3 years ago
b89a44090f
[naverwebtoon] fix comic extraction
3 years ago
4048eabeab
allow 'extractor.modules' to be a string
...
with comma-separated module names
3 years ago
c8e678a5b4
[instagram] fix extraction of '/explore/tags/' posts
...
(closes #1666 )
3 years ago
a6a51f207d
[moebooru] fix 'tags' ending with a '+' when logged in ( #1702 )
3 years ago
f5b097165e
[ytdl] transfer YoutubeDL objects to downloader ( #1680 )
...
allows specifying downloader-specific options per subcategory
but overwrites all downloader.ytdl settings
3 years ago
06e69ea79a
[ytdl] actually set options for YoutubeDL objects ( #1680 )
...
I somehow managed to remove the options parameter for
the YoutubeDL constructor in 9a849cdf
3 years ago
fc19010808
[downloader:ytdl] fix 'outtmpl' setting for yt_dlp ( #1680 )
...
yt_dlp supports multiple outtmpl settings for different file types and
uses its 'outtmpl_dict' for that.
3 years ago
dfe1f490e9
[mangadex] use custom User-Agent header ( #1535 )
3 years ago
36a2aff363
[vk] improve metadata extraction and URL pattern ( fixes #1691 )
...
- always fetch all user metadata
- use 'user[name]' for directory names if available
3 years ago
b9783403d9
add 'url-metadata' option ( #1659 , #1073 )
3 years ago
e622e004f0
[ytdl] improve module imports ( #1680 )
...
Apply 'extractor.ytdl.module' for every URL, not just the first.
3 years ago
e95f99882f
extend 'parent-metadata' functionality ( #1687 , #1651 , #1364 )
3 years ago
193401ce3b
[ytdl] "fix" cookie transfer between session and ytdl ( #1680 )
...
requests' CookieJar class is not quite compatible with the standard
http.cookiejar.CookieJar used by youtube_dl
3 years ago
9a849cdf61
[ytdl] allow setting 'module' for subcategories ( #1680 )
3 years ago
dff0da60f9
[ytdl] add 'generic' option ( #1680 )
3 years ago
d3da96142a
[ytdl] support cookies + username&password ( #1680 )
3 years ago
36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
...
(#1680 , #878 )
Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
3 years ago
64240c8d42
[imagevenue] fix extraction
...
(closes #1677 )
3 years ago
d287d2eb88
[kemonoparty] parse 'o' query parameters ( #1674 )
3 years ago
8b036778e3
[kemonoparty] add 'max-posts' option ( #1674 )
3 years ago
5612ca31c2
[hitomi] fix image URLs ( closes #1679 )
3 years ago
8ecca3af58
[pixiv] add extractor for 'pixivision' articles ( #1672 )
3 years ago
312a28e78a
[mastodon] add 'replies' option ( #1669 )
3 years ago
Mike Fährmann