Mike Fährmann
415c208c1f
[gfycat] cleanup
2 years ago
Mike Fährmann
a80ba17ed4
[gfycat] add 'collections' extractor ( #2629 )
2 years ago
Mike Fährmann
ff5e10a86d
[hypnohub] move to gelbooru_v02 instances ( #2631 )
2 years ago
Mike Fährmann
d6e744bf0f
[gfycat] add 'collection' extractor ( #2629 )
2 years ago
Mike Fährmann
4f7fe9b4be
[deviantart] fix folder listings with 'pagination: manual'
...
(#2488 )
2 years ago
Mike Fährmann
7990fe84f1
support user-defined 'output.mode' settings ( #2529 )
...
work in progress
the same output as produced by "mode": "color" can be achieved with
"output": {
"mode": {
"start" : "{}",
"success": "\r\u001b[1;32m{}\u001b[0m\n",
"skip" : "\u001b[2m{}\u001b[0m\n",
"progress" : "\r{0:>7}B {1:>7}B/s ",
"progress-total": "\r{3:>3}% {0:>7}B {1:>7}B/s "
}
}
to make 'output.shorten' work correctly, it is necessary to manually
specify the number of extra characters:
"start" : [12, "Downloading {}"]
2 years ago
Mike Fährmann
310fee99d5
[readcomiconline] remove automatic 'browser' setting ( #2625 )
2 years ago
Mike Fährmann
d4e9d51760
[reddit] add 'home' extractor ( #2614 )
2 years ago
Mike Fährmann
b51f5fd345
fix command-line argument name of --cookies-from-browser ( #1606 )
2 years ago
Mike Fährmann
1d5145a280
release version 1.22.0
2 years ago
Infinitay
f54525573b
[Instagram] Add tagged_users to keywords for stories ( #2582 ) ( #2584 )
2 years ago
thatfuckingbird
da0696e1f5
recognize vxtwitter URLs ( #2621 )
2 years ago
Mike Fährmann
dcb580240d
[twitter] extract alt texts as 'description' ( closes #2617 )
2 years ago
Mike Fährmann
44ffc017ea
remove useless 'tries' argument from out.success
2 years ago
Mike Fährmann
915dba8345
[twitter] improve results for regular user URLs
...
- continuation of 3346f58a
- use media timeline results (or tweet timeline if retweets are enabled)
plus search results starting from the last tweet id of the first
timeline, similar to how Twitter Media Downloader operates
- the old behavior can be forced by appending '/tweets' to a user URL,
like with '/media' (https://twitter.com/USER/tweets )
although there should be no need to ever do that
2 years ago
Mike Fährmann
6ad39f2b68
add ytdl tests
...
they only run when youtube-dl or yt-dlp are installed,
i.e. if __import__("<ytdl-package>") succeeds
2 years ago
Mike Fährmann
9df4e0f65b
[twitter] disable 'cards' by default
2 years ago
Mike Fährmann
79dce8ae68
[weasyl] implement 'metadata' option ( #2610 )
2 years ago
Mike Fährmann
64d3ad2e7a
detect circular references with -K ( fixes #2609 )
2 years ago
Mike Fährmann
9d5580a091
[khinsider] fix metadata extraction ( closes #2611 )
2 years ago
Mike Fährmann
688d6553b4
replace calls to print() with stdout_write() ( #2529 )
2 years ago
Mike Fährmann
cf16f9a407
[output] introduce 'stdout_write()' etc ( #2529 )
2 years ago
Mike Fährmann
86cbf485ab
[webtoons] extract real episode number ( #2591 )
...
The number from the 'episode_no' query parameter
got renamed to 'episode_no'.
2 years ago
Mike Fährmann
318b0ba93d
build executables on GitHub Actions with Python 3.10
2 years ago
Mike Fährmann
eeef9ccdc1
explicitly flush all writes to stdout ( #2529 )
2 years ago
Mike Fährmann
a96f9d29b5
create missing directories for archive files ( #2597 )
2 years ago
Mike Fährmann
82c1cc130b
[readcomiconline] update deobfuscation code ( #2481 )
2 years ago
Mike Fährmann
4005171db3
[pixiv] provide more metadata fields when option enabled ( #2594 )
2 years ago
Mike Fährmann
c8abb16c60
[mangahere] send Referer headers ( #2592 )
2 years ago
Mike Fährmann
3fd9249717
[mangafox] send Referer headers ( #2592 )
2 years ago
Mike Fährmann
90d28387ef
[instagram] detect empty story listings faster
2 years ago
Mike Fährmann
bd6ec5c352
[foolfuuka] match 4chan filenames ( #2577 )
...
introduce two new metadata fields:
- filename_media: original filename of file uploaded to 4chan
- timestamp_ms : timestamp with millisecond precision (tim)
2 years ago
Mike Fährmann
6ca998fc2b
[postprocessor:ugoira] ensure target directory exists ( #2576 )
...
another bug created by 99cb2872
in combination with 'part-directory'
2 years ago
Mike Fährmann
d1bb7fae2d
remove 'exist_ok=True' argument from several os.makedirs calls
...
makedirs in those places is only meant to create missing directories,
anything should be considered an error
2 years ago
Mike Fährmann
9c8647a4fd
fix 'part-directory' ( #2576 )
...
bug introduced in 99cb2872
2 years ago
Mike Fährmann
feb470d19a
[shopifx] natively support a few more sites ( closes #2089 )
...
- chelseacrew.com
- michaels.com.au
- modcloth.com
- pinupgirlclothing.com
- raidlondon.com (loveraid.com)
- unique-vintage.com
2 years ago
Mike Fährmann
60f4d59b1e
[gelbooru_v01] remove 'tlb.booru.org' from supported domains
...
403 Forbidden
nginx
it is also no longer listed on https://booru.org/top
2 years ago
Mike Fährmann
6b6eb0b8f6
[lolisafe] implement 'domain' option ( #2575 )
2 years ago
Mike Fährmann
f3408a9d92
implement string literals in replacement fields
...
- either {_lit[foo]} or {'foo'}
- useful as alternative for empty metadata fields: {title|'no title'}
- due to using '_string.formatter_field_name_split()' to parse format
strings, using certain characters will result in an error: [].:!
2 years ago
Mike Fährmann
d26da3b9e5
add pre-generated 'pattern' for supported BaseExtractor sites
2 years ago
Mike Fährmann
6ae3a5cdb0
[pixiv] make retrieving ugoira metadata non-fatal ( #2562 )
2 years ago
Mike Fährmann
aa2db7abeb
[cookies] cleanup ( #1606 )
...
- fix Popen.communicate() calls
- move and simplify _process_chrome_cookie() code
- remove random print() statement and config dict
2 years ago
Mike Fährmann
6742f3bc1e
implement --cookies-from-browser ( #1606 )
...
most of the code is adapted from yt-dlp's implementation
and *should* work the same.
2 years ago
Mike Fährmann
c4b9f7bab8
update functions working with cookies.txt files
...
- rename
- load_cookiestxt -> cookiestxt_load
- save_cookiestxt -< cookiestxt_store
- in cookiestxt_load, add cookies directly to a cookie jar
instead of storing them in a list first
- other unnoticeable performance increases
2 years ago
Mike Fährmann
f190018e37
[mangasee] use randomly generated PHPSESSID cookie ( #2560 )
2 years ago
Mike Fährmann
4c47dfffdd
[instagram] report redirects to captcha challenges ( #2543 )
2 years ago
Mike Fährmann
99cb28724f
delay directory creation ( #2461 , #2474 )
...
Only call os.makedirs() when an open() call
fails with a FileNotFoundError
Might cause errors with some post processors etc,
but for now I was unable to find any.
2 years ago
Mike Fährmann
4c8e28db82
avoid circular import in util.py
2 years ago
Mike Fährmann
4598d32370
[imgur] prevent exception for empty albums ( closes #2557 )
2 years ago
Mike Fährmann
435e9c5d2e
[vk] report errors for private albums ( #2556 )
2 years ago