fba95c3a9e
[nozomi] preserve case of search tags ( fixes #1860 )
3 years ago
7b05600056
[pinterest] only mention cookies for authentication ( #1856 )
...
regular login is broken due to CAPTCHA
3 years ago
4b3e309b90
[aryion] update/improve pagination ( #1849 )
...
Manually increment the 'p' query parameter,
instead of relying on a "Next" link which only works up to page 200.
3 years ago
266ed9b62e
[aryion] add 'tag' extractor ( closes #1849 )
3 years ago
6bbeaac029
[mangadex] fix extraction ( fixes #1852 )
3 years ago
e9bf8d2591
[instagram] update default delay to 6-12 seconds ( #1835 )
3 years ago
c9e6693530
allow specifying a minimum/maximum for 'sleep-*' options ( #1835 )
...
for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10
seconds between each HTTP request
3 years ago
bd845303ad
implement a way to shorten filenames with east-asian characters
...
(#1377 )
Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower
algorithm that also considers characters with a width > 1.
3 years ago
2ff2974353
[common] update default argument handling in Extractor.request()
...
more lines of code, but slightly less execution time
3 years ago
0fd959a2a7
[twitter] support '/with_replies' URLs ( closes #1833 )
3 years ago
e93360e45d
[reddit] extend subcategory depending on input URL ( closes #1836 )
...
- https://www.reddit.com/r/lavaporn/
-> 'subreddit'
- https://www.reddit.com/r/lavaporn/new/
-> 'subreddit-new'
- https://www.reddit.com/user/username/
-> 'user'
- https://www.reddit.com/user/username/gilded/
-> 'user-gilded'
3 years ago
7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor ( closes #1834 )
3 years ago
4ec11af6a4
[kemonoparty] implement login with username & password ( #1824 )
3 years ago
0e33746fe0
[artstation] use '/album/all' view for user portfolios ( #1826 )
3 years ago
4f5f9ed1e5
[oauth] fix typo
...
this has been here since February ...
(8974f036
3 years ago
83bbb628d8
[kemonoparty] add 'favorite' extractor ( #1824 )
3 years ago
35d75a4071
[erome] send Referer header for file downloads ( fixes #1829 )
3 years ago
44f572c27f
[deviantart] implement a 'auto-unwatch' option ( #1466 , #1757 )
3 years ago
d79bcb6236
allow extractors to register a 'finalize()' method
3 years ago
9158853ff7
release version 1.18.4
3 years ago
268c9ca034
update default gallery-dl.conf
3 years ago
47a780942c
update extractor test results
3 years ago
eed6ef3de0
[pixiv] fix pixivision title extraction
3 years ago
7645cdfb88
[inkbunny] fix extraction ( closes #1816 )
...
'digitalsales', 'forsale', and 'printsales'
are no longer included in the data returned from the API.
3 years ago
3e36543c98
[nhentai] add 'favorite' extractor ( #1814 )
3 years ago
656358ea92
[nhentai] use API endpoint for gallery data
3 years ago
8cd7759682
[reddit] cleanup ReddeitAPI.__init__ ( #1813 )
...
- remove warning about 'client-id'/'user-agent' mismatch
- only use 'user-agent' from config for custom 'client-id'
3 years ago
0a94fe5774
[reddit] delay RedditAPI initialization ( #1813 )
...
Move it outside the constructor so that eventual exceptions can get
caught in the expected places.
3 years ago
57854624a1
[exhentai] improve image limits check ( #1808 )
...
Check for a 'text/html' Content-Type instead of the very specific
137 bytes Content-Length, which might change depending on compression
or other factors.
3 years ago
96fec14ef7
[deviantart] rename 'watch' option to 'auto-watch'
...
(#1466 , #1757 )
Similar reason as in e05a96db
3 years ago
e75f2de9da
[deviantart] add 'comments' option ( #1800 )
3 years ago
6ce16c6d31
[deviantart] add 'tag' extractor ( closes #1803 )
3 years ago
4e9f8fe395
[shopify] support windsorstore.com ( #1793 )
3 years ago
95157e0f4b
[shopify] use API for product listings ( #1793 )
3 years ago
292fffc83c
add 'j' format string conversion
...
to convert to a JSON formatted string
3 years ago
6651da27e9
[twitter] fix 'url' extraction for users without 'expanded_url'
...
(#1532 , #1787 )
3 years ago
ecc8da4704
[deviantart] implement a 'watch' option ( #1466 , #1757 )
3 years ago
a4f249c22e
[deviantart] prevent exception on empty videos ( fixes #1796 )
3 years ago
ae78d95a5f
[twitter] fix issue when filtering quote tweets ( #1792 )
...
When a user quotes his own Tweet and that Tweet gets filtered by
'"quoted": false', it could also get filtered when it appeared later
as regular Tweet.
3 years ago
d3eab417ed
implement a 'path-strip' option
3 years ago
72c0cd30c7
do not return with a nonzero exit status when no results found
...
also change loglevel from 'warning' to 'info'
(#1789 )
3 years ago
6b229ac829
[furaffinity] expand URL pattern for searches ( closes #1780 )
3 years ago
0817f468ef
[twitter] expand t.co links in user descriptions ( #1532 , #1787 )
3 years ago
7c0ae88185
[twitter] add 'url' to user objects ( #1532 , #1787 )
3 years ago
5919dc5b5a
[twitter] slightly improve '_transform_user()'
3 years ago
c04f7ab139
[foolfuuka] add 'gallery' extractor ( #1785 )
3 years ago
ddd175de77
[mangadex] prevent KeyError for manga without English title
3 years ago
20ee091289
[429chan] add 'thread' and 'board' extractors ( closes #1773 )
3 years ago
6b56b3ebe1
[twitter] report API errors as generic StopExtraction exceptions
...
prevents duplicate logging messages for nonexistent users
(#1759 )
3 years ago
51eb50749f
[foolslide] remove entry for kobato.hologfx.com
3 years ago
Mike Fährmann