Mike Fährmann
699592498b
[tests] use random port number for local HTTP server
...
… and explicitly bind to 127.0.0.1 instead of all interfaces
5 months ago
Mike Fährmann
625740c3d2
merge #5538 : [cookies] optimize _find_most_recently_used_file for exact profiles
5 months ago
Jan Wikholm
06d102f19a
optimize _find_most_recently_used_file for exact profile
...
When reading cookies from the browser, the user is able to give either just the browser name, or also provide profile/container information.
If an exact profile is provided, there is no need to find the latest profile with `os.walk` which is very expensive.
This change optimizes that case and the performance increase is significant (~8 sec to 0.6 sec).
```
$ time gallery-dl --config-ignore -d . -D . --cookies-from-browser FIREFOX https://imgur.com/OO4UNqJ
[cookies][info] Extracted 16 cookies from Firefox
./imgur_OO4UNqJ.jpg
real 0m8.429s
user 0m0.216s
sys 0m0.431s
$ time gallery-dl --config-ignore -d . -D . --cookies-from-browser FIREFOX:bgamf5r6.default-release https://imgur.com/OO4UNqJ
[cookies][info] Extracted 16 cookies from Firefox
./imgur_OO4UNqJ.jpg
real 0m0.456s
user 0m0.183s
sys 0m0.011s
$ gallery-dl --version
1.26.9
```
5 months ago
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor ( #5341 )
5 months ago
Mike Fährmann
d0cead105b
[formatter] allow dots etc in '…' literals ( #5539 )
...
don't parse fields starting with '
this disables the ability to directly apply […] to '…' literals,
but that's not really useful anyway and can still be done with _lit
5 months ago
Mike Fährmann
619bf5c644
[inkbunny] retry API calls with a loop instead of recursion
5 months ago
Mike Fährmann
8ed70b3256
[tests] mark tests with missing auth as 'only_matching'
...
… instead of skipping them completely
5 months ago
Mike Fährmann
d11ec00908
[common] fix _cfgpath for BaseExtractor objects
...
After the changes in 0c17884673
,
_cfgpath was mssing its 'category' value
since that hadn't been initialized yet.
5 months ago
Mike Fährmann
6db1837a6d
[bluesky] filter reposts only for user timelines ( #5528 )
5 months ago
Mike Fährmann
3cf5366143
[mastodon] add support for card images
5 months ago
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors ( #5529 )
5 months ago
Mike Fährmann
7fd31aaf8e
merge #5516 : [mastodon] send canonical 'true'/'false' boolean values
...
instead of '1'/'0' to be compatible with Mitra instances or others that
do not fully implement Mastodon's boolean value semantics.
5 months ago
cenodis
3ba5fd9efd
[mastodon] Use boolean instead of integer keys for accounts/statuses endpoint
5 months ago
Mike Fährmann
6c57958806
merge #5511 : [twitter] [furaffinity] match fixvx.com and fxfuraffinity/fxraffinity.net URLs
5 months ago
Mike Fährmann
5aefa9465c
[furaffinity] simplify pattern, match original domain first
5 months ago
Delphox
1886721d82
update tests
5 months ago
Delphox
6969963125
[furaffinity] support fxfuraffinity and fxraffinity urls
5 months ago
Delphox
85550a37c4
[twitter] support fixvx urls
5 months ago
Mike Fährmann
cd241bea0a
[downloader:http] add MIME type and signature for .m4v files ( #5505 )
5 months ago
Mike Fährmann
bef0bd3b49
add '--no-colors' command-line option
5 months ago
Mike Fährmann
20e2c0042b
[output] enable colors by default
5 months ago
Mike Fährmann
14b38264e0
[output] extend 'output.colors' ( #2566 )
...
allow specifying ANSI colors for all loglevels
(debug, info, warning, error)
5 months ago
Mike Fährmann
ddffeeaa7b
[exhentai] detect CAPTCHAs during login ( #5492 )
5 months ago
Mike Fährmann
068ccfe0b3
[tests] allow filtering extractor result tests by URL or comment
...
python test_results.py twitter:+/i/web/
python test_results.py twitter:~twitpic
5 months ago
Mike Fährmann
347af7f5c8
[twitter] handle missing 'expanded_url' fields ( #5463 , #5490 )
5 months ago
Mike Fährmann
c9d3b5e5d9
[pixiv] change 'sanity_level' debug message to a warning ( #5180 )
5 months ago
Mike Fährmann
bffadf35b7
[hotleak] download files with 404 status code ( #5395 )
5 months ago
Mike Fährmann
a7d8cbab0e
[common] show full URL in Extractor.request() error messages
5 months ago
Mike Fährmann
a5071c9ca0
[common] fix NameError in Extractor.request()
...
… when accessing 'code' after an requests exception was raised.
Caused by the changes in 566472f080
5 months ago
Mike Fährmann
566472f080
[common] add 'sleep-429' option ( #5160 )
5 months ago
Mike Fährmann
923c6f3214
[common] simplify 'status_code' check in Extractor.request()
5 months ago
Mike Fährmann
68f4208251
[common] update Extractor.wait() message format
5 months ago
Mike Fährmann
9e5d65fbf3
[twitter] improve username & password login procedure ( #5445 )
...
- handle more subtasks
- support 2FA
- support email verification codes
5 months ago
Mike Fährmann
b38a917355
[common] add Extractor.input() method
5 months ago
Mike Fährmann
257e9fb435
[gelbooru] improve pagination logic for meta tags ( #5478 )
...
similar to 494acabd38
5 months ago
Mike Fährmann
4cf24f15c2
merge #5474 : add '-w/--warning' command-line option
5 months ago
Aidan Harris
a2affdcef3
re-order verbose and warning options
5 months ago
Aidan Harris
a3f580254a
Add warnings flag
...
This commit adds a warnings flag
It can be combined with -q / --quiet to display warnings.
The intent is to provide a silent option that still surfaces
warning and error messages so that they are visible in logs.
5 months ago
Mike Fährmann
0d72789aa3
merge #5461 : [cookies] use tempfile when saving cookies.txt files
5 months ago
Mike Fährmann
63ac06643f
compute tempfile path only once
5 months ago
Mike Fährmann
5227bb6b1d
[text] catch general Exceptions
5 months ago
Mike Fährmann
6dac43ad60
[docs] replace AnchorJS with custom script
...
use it in rendered .rst documents as well as in .md ones
5 months ago
Mike Fährmann
141a93c8fd
[docs] update docs/configuration links ( #5059 , #5369 , #5423 )
5 months ago
Mike Fährmann
85bbb59483
[twitter] implement 'relogin' option ( #5445 )
5 months ago
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor ( #5306 )
5 months ago
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option ( #5373 )
5 months ago
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis
5 months ago
Mike Fährmann
40c1a8e471
[wikimedia] fix exception for files with empty 'metadata'
5 months ago
Mike Fährmann
0e730ba980
[pp:mtime] do not overwrite '_mtime' for None values ( #5439 )
6 months ago
Mike Fährmann
647a87d17c
[twitter] match '/photo/' Tweet URLs ( #5443 )
...
fixes regression introduced in 40c05535
6 months ago