9c8647a4fd
fix 'part-directory' ( #2576 )
...
bug introduced in 99cb2872
2 years ago
feb470d19a
[shopifx] natively support a few more sites ( closes #2089 )
...
- chelseacrew.com
- michaels.com.au
- modcloth.com
- pinupgirlclothing.com
- raidlondon.com (loveraid.com)
- unique-vintage.com
2 years ago
60f4d59b1e
[gelbooru_v01] remove 'tlb.booru.org' from supported domains
...
403 Forbidden
nginx
it is also no longer listed on https://booru.org/top
2 years ago
6b6eb0b8f6
[lolisafe] implement 'domain' option ( #2575 )
2 years ago
f3408a9d92
implement string literals in replacement fields
...
- either {_lit[foo]} or {'foo'}
- useful as alternative for empty metadata fields: {title|'no title'}
- due to using '_string.formatter_field_name_split()' to parse format
strings, using certain characters will result in an error: [].:!
2 years ago
d26da3b9e5
add pre-generated 'pattern' for supported BaseExtractor sites
2 years ago
6ae3a5cdb0
[pixiv] make retrieving ugoira metadata non-fatal ( #2562 )
2 years ago
aa2db7abeb
[cookies] cleanup ( #1606 )
...
- fix Popen.communicate() calls
- move and simplify _process_chrome_cookie() code
- remove random print() statement and config dict
2 years ago
6742f3bc1e
implement --cookies-from-browser ( #1606 )
...
most of the code is adapted from yt-dlp's implementation
and *should* work the same.
2 years ago
c4b9f7bab8
update functions working with cookies.txt files
...
- rename
- load_cookiestxt -> cookiestxt_load
- save_cookiestxt -< cookiestxt_store
- in cookiestxt_load, add cookies directly to a cookie jar
instead of storing them in a list first
- other unnoticeable performance increases
2 years ago
f190018e37
[mangasee] use randomly generated PHPSESSID cookie ( #2560 )
2 years ago
4c47dfffdd
[instagram] report redirects to captcha challenges ( #2543 )
2 years ago
99cb28724f
delay directory creation ( #2461 , #2474 )
...
Only call os.makedirs() when an open() call
fails with a FileNotFoundError
Might cause errors with some post processors etc,
but for now I was unable to find any.
2 years ago
4c8e28db82
avoid circular import in util.py
2 years ago
4598d32370
[imgur] prevent exception for empty albums ( closes #2557 )
2 years ago
435e9c5d2e
[vk] report errors for private albums ( #2556 )
2 years ago
9adea93aef
[pixiv] updates to avatar/background extractors ( #2495 )
...
- add 'date' metadata to avatar/background files when available
and use that in default filenames / archive ids
- remove deprecation warnings as their option names clash with
subcategory names
2 years ago
3e6aba05ab
[vk] add fallback for user ID extraction ( #2535 )
2 years ago
61887c895b
implement 'output.colors' options ( #2532 )
2 years ago
52b47c3cf9
[gelbooru_v01] add 'favorite' extractor ( #2546 )
2 years ago
5b7423d14c
[vk] fix URLs for older photos ( #2535 )
2 years ago
3346f58a2a
[twitter] use twMediaDownloader strategy for user URLs
...
- use media timeline + search for default user URLs like
https://twitter.com/SCREEN_NAME
- fetches all/most media for the type of twitter URL that most users
use with gallery-dl
- can be disabled by setting 'strategy' to any truthy value,
like "timeline"
2 years ago
84756982e9
[pixiv] implement 'include' option
...
- split 'user' extractor and its 'avatar' and 'background' options into
separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
https://www.pixiv.net/en/users/ID/avatar
as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
the same effect as before
2 years ago
d11e2191ae
[nijie] support /history_nuita.php listings ( closes #2541 )
2 years ago
4aca29b7b4
[naverwebtoon] support (best)challenge comics ( closes #2542 )
...
and update URL pattern to match URLs without '.nhn'
2 years ago
3e926bd465
[realbooru] fix extraction ( fixes #2530 )
2 years ago
82eee72b39
[pixiv] update API interface
...
- start all endpoints with '/'
- use extractor.wait() for rate limit
- retry with while loop instead of recursion
- in case of error, write entire response to debug log
2 years ago
1bc77efa02
[artstation] use "browser": "firefox" by default ( #2527 )
2 years ago
a39e7b7366
[vk] handle photos without width/height info ( fixes #2535 )
2 years ago
9e6c981388
replace '\f' in --filename arguments with form feed character
...
to make it easier to use special type format strings on command-line
(#2396 )
2 years ago
61afa973b7
use extended format strings for archive keys
2 years ago
1c95530525
release version 1.21.2
2 years ago
0381752575
[photovogue] switch to .com, update api endpoint ( #2494 )
2 years ago
3f02e483c6
[e621] fix applying request_interval_min ( #2533 )
...
Setting this property after calling Extractor.__init__() has no effect.
2 years ago
ca3a364db7
fix build_duration_func() ( #2533 )
...
for extractors with request_interval_min > 0
2 years ago
afde76269c
[weibo] fix infinite retries for deleted accounts ( fixes #2521 )
2 years ago
d85e66bcac
[vk] fix extraction ( #2512 )
...
Use a different API endpoint, since thumbnail URLs from the old one
cannot be transformed into URLs for "original" photos anymore.
2 years ago
9e6ff42a9d
[pixiv] implement 'background' option ( #623 , #1124 , #2495 )
2 years ago
dc22a47c99
[postprocessor:ugoira] report errors with ffmpeg/mkvmerge ( #2487 )
2 years ago
4d1896830f
[mangadex] download chapters with 'externalUrl' ( fixes #2503 )
...
if the have pages hosted on mangadex
2 years ago
97e8a15295
[deviantart] implement 'pagination' option ( #2488 )
2 years ago
1f9a0e2fd8
update extractor test results
2 years ago
ad5a4b1756
[twitter] fix various syndication issues
...
- handle retweets
- fix videos without dimensions in URL (3e942a58#2499 )
2 years ago
12bd9ba33a
[readcomiconline] add 'quality' option ( #2467 )
2 years ago
60ad46ddcc
[readcomiconline] unobfuscate image URLs ( #2481 )
2 years ago
a6c4ff58fb
[cyberdrop] match cyberdrop.to URLs ( closes #2496 )
2 years ago
13ed18b9aa
[lolisafe] fix typo
...
LolisafelbumExtractor -> LolisafeAlbumExtractor
2 years ago
24ea1398bc
[postprocessor:ugoira] do not auto-select image2 demuxer ( #2492 )
2 years ago
3e942a58be
[twitter] improve syndication video selection ( #2354 )
...
- ignore .m3u8 manifests
- always select largest format
2 years ago
0794027100
[issuu] fix extraction ( #2483 )
2 years ago
Mike Fährmann