Mike Fährmann
df8050b81d
[postprocessor:compare] add 'equal' option ( #1592 )
...
Move functionality from cdd72e14
to its own option,
where it can be used with any 'action'
3 years ago
Mike Fährmann
f8410203ef
release version 1.19.0
3 years ago
Mike Fährmann
cdd72e1413
[postprocessor:compare] extend 'action' option ( #1592 )
...
allow setting it to "abort", "terminate", or "exit" as with 'skip'
3 years ago
Mike Fährmann
fb98b3fdaf
[redgifs][gfycat] remove webtoken code ( fixes #1907 )
3 years ago
Mike Fährmann
96215c926e
[mangadex] fix retrieving chapters from 'pornographic' titles
...
(fixes #1908 )
3 years ago
Mike Fährmann
da9685609c
[kemonoparty] update file download URLs
...
(closes #1902 , fixes #1903 )
3 years ago
Mike Fährmann
783eae6fc5
[hiperdex] fix extraction
3 years ago
Mike Fährmann
12fc646c53
fix filename formatting tests
3 years ago
Mike Fährmann
2977f1a6b9
re-enable py2exe in setup.py
...
had to patch the native 'certifi' hook to
def hook_certifi(finder, module):
import certifi
finder.add_datafile_to_zip("certifi/cacert.pem", certifi.where())
to make everything work
3 years ago
Mike Fährmann
28f1c36da2
simplify and adjust download progress indicator ( #1519 )
3 years ago
Mike Fährmann
e0bdacd932
[fappic] add 'image' extractor ( closes #1898 )
3 years ago
Mike Fährmann
c22ff97743
remove 'unit' argument from 'util.format_value()'
3 years ago
Mike Fährmann
8c29a6e491
add example for 'url-metadata' option ( closes #1884 )
3 years ago
Mike Fährmann
d0761454b1
implement a download progress indicator ( #1519 )
3 years ago
Mike Fährmann
cad85640de
move 'util.PathFormat' into its own 'path' module
...
to prevent circular imports between 'formatter' and 'util'
3 years ago
Mike Fährmann
0038a8c1a4
implement a way to specify 'extended' format strings
...
Starting a format string with '\f<Type> ' allows to set a different
format string type than the default. Available ones are
- T: A template file containing the actual format string
"\fT ~/.templates/booru.txt
- E: An arbitrary Python expression
"\fE title.upper().replace(' ', '-')"
- M: Name of a Python module followed by a function name inside it.
This function gets called with the current metadata dict as
argument and should return a string.
"\fM my_module:generate_text"
'\f' was chosen since it is highly unlikely that a regular format string
would start with it, but that character could be changed to for example
'\\' or '/' etc.
3 years ago
Mike Fährmann
76c7d3f977
add FUNDING.yml ( #1877 )
3 years ago
Mike Fährmann
74145467dd
move 'util.Formatter' into its own 'formatter' module
3 years ago
Mike Fährmann
9377543162
[mastodon] add 'following' extractor ( #1891 )
3 years ago
Mike Fährmann
2c2932973c
[mastodon] support specifying accounts by ID
...
Same as a3b473bd
for Twitter
Instead of just
https://instance.tld/@user
it is now also possible to refer to that account with
https://instance.tld/users/user
https://instance.tld/@id:12345
https://instance.tld/users/id:12345
3 years ago
Mike Fährmann
94143eb86c
[twitter] add 'quote_by' metadata field ( #1481 )
...
Only present for tweets quoted by another tweet.
Represents the tweet_id of said tweet quoting this one.
3 years ago
Mike Fährmann
1cc73e11aa
add '--write-infojson' command-line option
3 years ago
Mike Fährmann
a23f5d45d7
[deviantart] fix bug with fetching premium content ( #1879 )
...
When a user has both 'watchers' and 'paid' folders and one of them is
inaccessible, the other one could get handled as inaccessible as well.
3 years ago
Mike Fährmann
ada36c2044
[deviantart] update default archive_fmt for single deviations
...
(#1874 )
use the same as gallery downloads
3 years ago
Mike Fährmann
140a7bfdcd
update --clear-cache command in deviantart client-id instructions
3 years ago
Mike Fährmann
da16eabb82
[twitter] ensure card entries have a 'url' ( #1868 )
3 years ago
Mike Fährmann
e69ee41f25
implement 'page-reverse' option ( #1854 )
3 years ago
cyberdrop-me
c83668c2ff
[CyberDrop] Change directory name format ( #1871 )
...
Album IDs are random, organization would be much better having the album name then the identifier at the end
3 years ago
Mike Fährmann
e4684c5cb9
[desktopography] simplify ( #1740 )
3 years ago
Giacomo Rossetto
4a7d7899ff
Implement desktopography extractor ( #1740 )
3 years ago
Alice
9992ff38da
[fantia] add 'date' metadata field ( #1853 )
3 years ago
Mike Fährmann
fba95c3a9e
[nozomi] preserve case of search tags ( fixes #1860 )
3 years ago
Mike Fährmann
7b05600056
[pinterest] only mention cookies for authentication ( #1856 )
...
regular login is broken due to CAPTCHA
3 years ago
Mike Fährmann
4b3e309b90
[aryion] update/improve pagination ( #1849 )
...
Manually increment the 'p' query parameter,
instead of relying on a "Next" link which only works up to page 200.
3 years ago
Mike Fährmann
266ed9b62e
[aryion] add 'tag' extractor ( closes #1849 )
3 years ago
Mike Fährmann
6bbeaac029
[mangadex] fix extraction ( fixes #1852 )
3 years ago
Mike Fährmann
e9bf8d2591
[instagram] update default delay to 6-12 seconds ( #1835 )
3 years ago
Mike Fährmann
c9e6693530
allow specifying a minimum/maximum for 'sleep-*' options ( #1835 )
...
for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10
seconds between each HTTP request
3 years ago
Mike Fährmann
bd845303ad
implement a way to shorten filenames with east-asian characters
...
(#1377 )
Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower
algorithm that also considers characters with a width > 1.
3 years ago
Mike Fährmann
2ff2974353
[common] update default argument handling in Extractor.request()
...
more lines of code, but slightly less execution time
3 years ago
Mike Fährmann
0fd959a2a7
[twitter] support '/with_replies' URLs ( closes #1833 )
3 years ago
Mike Fährmann
e93360e45d
[reddit] extend subcategory depending on input URL ( closes #1836 )
...
- https://www.reddit.com/r/lavaporn/
-> 'subreddit'
- https://www.reddit.com/r/lavaporn/new/
-> 'subreddit-new'
- https://www.reddit.com/user/username/
-> 'user'
- https://www.reddit.com/user/username/gilded/
-> 'user-gilded'
3 years ago
Mike Fährmann
7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor ( closes #1834 )
3 years ago
Mike Fährmann
4ec11af6a4
[kemonoparty] implement login with username & password ( #1824 )
3 years ago
Mike Fährmann
0e33746fe0
[artstation] use '/album/all' view for user portfolios ( #1826 )
3 years ago
Mike Fährmann
4f5f9ed1e5
[oauth] fix typo
...
this has been here since February ...
(8974f036
)
3 years ago
Mike Fährmann
83bbb628d8
[kemonoparty] add 'favorite' extractor ( #1824 )
3 years ago
Mike Fährmann
35d75a4071
[erome] send Referer header for file downloads ( fixes #1829 )
3 years ago
Mike Fährmann
44f572c27f
[deviantart] implement a 'auto-unwatch' option ( #1466 , #1757 )
3 years ago
Mike Fährmann
d79bcb6236
allow extractors to register a 'finalize()' method
3 years ago