3842cdcd8f
[formatter] implement 'D' format specifier
...
To be able to parse any string into a 'datetime' object
and format it as necessary.
Example:
{created_at:D%Y-%m-%dT%H:%M:%S%z}
->
"2010-01-01 00:00:00"
{created_at:D%Y-%m-%dT%H:%M:%S%z/%b %d %Y %I:%M %p}
->
"Jan 01 2010 12:00 AM"
with 'created_at' == "2010-01-01T01:00:00+0100"
3 years ago
3a7a19c7b9
[dynastyscans] add 'manga' extractor ( closes #2035 )
3 years ago
9bc83af3a6
[kemonoparty] 'postfile' -> 'file' ( #1991 )
...
to stay consistent with the existing file types for kemono
3 years ago
522782c09d
[subscribestar] emit metadata for posts without media ( #1569 )
3 years ago
1c8aaf9318
[subscribestar] add 'num' enumeration index ( closes #2040 )
3 years ago
d433735750
[kemonoparty] skip duplicate files ( #2032 , #1991 , #1899 )
...
Extract the SHA-256 file hash from URLs
and skip files with the same hash in the same post.
- provide a 'hash' metadata field (empty string if not available)
- remove 'patreon-skip-file' option
3 years ago
d4ec245554
[kemonoparty] implement a 'files' option ( #1991 )
...
similar to 8d676151
3 years ago
ab8eea1a24
[twitter] fix extractor for direct image links ( fixes #2030 )
3 years ago
2076d40681
[ytdl] improve error handling ( #1680 )
3 years ago
8eaedb0bd3
[ytdl] fix some compatibility issues ( #1680 )
3 years ago
2aaac3c997
[instagram] include user metadata for 'tagged' downloads ( #2024 )
...
Adds
- tagged_owner_id
- tagged_full_name
- tagged_username
containing the values for the user profile the URL originated from,
e.g. 'instagram' for https://www.instagram.com/instagram/tagged/ .
3 years ago
cfa4876848
[philomena] support furbooru.org ( closes #1995 )
3 years ago
4377f1c284
[twitter] distinguish between fatal & nonfatal errors ( #2020 )
...
only show a warning for nonfatal errors
and do not raise a StopExtraction exception
3 years ago
7c50f473e4
[ytdl] document 'cmdline-args' and 'config-file' options ( #1680 )
3 years ago
19403a7fff
[downloader:ytdl] prevent crash in '_progress_hook()' ( #1680 )
...
'speed' is not guaranteed to be defined or convertible to 'int'
3 years ago
01b28f3674
[ytdl] fix syntax for Python 3.4
3 years ago
a14b72be21
[webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net ( #2005 )
...
* [webtoons] Use swebtoon-phinf.pstatic.net instead of webtoon-phinf.pstatic.net
This trick to avoid having to set a Referer header comes from
Webtoon's RSS feeds. The two URLs below are equivalent in content:
https://webtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90
https://swebtoon-phinf.pstatic.net/20210929_153/1632867980912DmcGK_JPEG/16328679808882705182.jpg?type=q90
The URL with the domain "webtoon-phinf.pstatic.net" needs a Referer
header, and the domain "swebtoon-phinf.pstatic.net" does not. This
is because of the environment "swebtoon" images live in, one without
explicit network control: RSS feeds on sites such as Feedly. This change should
make it easier for gallery-dl developers to embed Webtoon comics without
worrying about headers.
3 years ago
6e3658ef52
[kemonoparty] provide 'date' metadata for gumroad ( #2007 )
...
Not the 'published' or 'edited' values since they are 'null',
but still better then nothing at all.
3 years ago
f4d201f626
[ytdl] fix syntax for Python 3.4
3 years ago
37c9dedee1
[seisoparty] remove module
3 years ago
efa178cc91
[ytdl] implement parsing ytdl command-line options ( #1680 )
...
- adds 'config-file' and 'cmdline-args' options
for both ytdl downloader and extractor
- create 'ytdl' helper module, which combines YoutubeDL creation
and option parsing.
- most likely a buggy mess due to incompatibilities between the
original youtube-dl and yt-dlp.
3 years ago
a881305357
release version 1.19.2
3 years ago
7cb303d745
[redgifs] improve URL extraction
...
Fields inside 'urls' can be None, which would have caused an exception
with the old method.
3 years ago
2befed1a96
[redgifs] update search URL pattern ( #1984 )
3 years ago
b315a0ecef
[redgifs] update to API v2 ( #1984 )
3 years ago
f0fc3b0ba1
[kemonoparty] add 'comments' option ( #1980 )
3 years ago
1fac74b14d
[reddit] prevent crash for galleries with no 'media_metadata'
...
(fixes #2001 )
3 years ago
2ab190ce08
add tests for special format strings
3 years ago
211de95dd0
update extractor test results
3 years ago
8bea02c38c
[deviantart] fix 'index' values for stashed deviations
3 years ago
dd88a7d980
{cyberdrop] restore video extraction ( fixes #1993 )
...
fixes a regression introduced in f33c2ef7
3 years ago
fa5646eadc
[mangoxo] fix login and extraction
3 years ago
4c49174579
[mangakakalot] update domain and fix extraction
3 years ago
69cd573809
add special type format strings to docs ( #1987 )
3 years ago
14852f7050
[hitomi] fix image path ( #1988 )
3 years ago
46e17c5e61
support accessing the current local datetime in format strings
...
{_now}, {_now:%Y-%m-%d}, etc
(#1968 )
3 years ago
dad2875a3e
fix calculating retry sleep times ( fixes #1990 )
3 years ago
9156e90f1f
[twitter] add 'pinned' option
3 years ago
06b414c9a3
[redgifs] 'gfyId' -> 'id' ( #1984 )
3 years ago
d4614e5ba4
[hitomi] fix image URLs ( #1982 )
3 years ago
6434ccf9e8
[redgifs] split from 'gfycat' ( #1984 )
...
Update API endpoints and metadata names - mostly 'gfycat' -> 'gif' -
and remove some obsolete checks.
3 years ago
38193dba46
support accessing environment variables in format strings ( #1968 )
...
{_env[HOME]} to get the value of $HOME
every other format string feature is supported as well
3 years ago
e4696b40ba
[instagram] update query hashes
3 years ago
bfd7401b1e
[skeb] add 'user' and 'post' extractors ( #1031 ) ( #1971 )
...
* Create skeb.py
* Update __init__.py
* Update supportedsites.py
* Update supportedsites.md
* Update supportedsites.py
* Update skeb.py
3 years ago
6b6d92d51c
[hitomi]: fix image URLs ( #1975 )
3 years ago
dcb201ff19
[gfycat] show warning when there are no available formats
3 years ago
e436a2607b
[gfycat] consistent 'userName' values for 'user' downloads ( #1962 )
...
by using the name from the input URL and not relying on possibly faulty
or incomplete API results.
'userData[username]', if available, will still have the original name.
3 years ago
ba9579c504
release version 1.19.1
3 years ago
f1487a3cfa
[kemonoparty:discord] improve 'inline' extraction ( #1940 )
...
- extract media.discordapp.*NET* URLs
- rewrite media.discordapp.net to cdn.discordapp.com
- use a more restricted set of characters for the URL path
3 years ago
02a247f4e5
[deviantart] full resolution for non-downloadable images ( #293 )
...
Many thanks to @Ironchest337 for discovering this method
and providing a well-documented implementation.
3 years ago
Mike Fährmann
