Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
3 months ago
Mike Fährmann
51fdfbe6fc
[erome] extract 'date' metadata ( #5796 )
3 months ago
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier ( #5770 )
3 months ago
enduser420
5adbfe526d
[tcbscans] support other domains
3 months ago
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
3 months ago
Mike Fährmann
8452d04a33
[fanbox] handle KeyError for no longer existing plans ( #5759 )
...
return the plan of the next higher tier instead
3 months ago
Mike Fährmann
ae3706286a
[speakerdeck] inherit from GalleryExtractor
3 months ago
Mike Fährmann
9c65db2a92
consistent 'with open(…) as fp:' syntax
3 months ago
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
3 months ago
Mike Fährmann
86f0c3baaf
[szurubooru] support empty tag searches ( #5711 )
3 months ago
Mike Fährmann
2e11b6e756
[nijie] support downloading videos ( #5707 , #5617 )
3 months ago
Mike Fährmann
f160859c5c
[hitomi] extract 'title_jpn' metadata ( #5706 )
4 months ago
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' ( #5632 )
4 months ago
Mike Fährmann
7614bc458e
[util] extend CustomNone with comparison operators
4 months ago
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier ( #5647 )
...
to apply a conversion after ':' or
to apply multiple conversions
for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
4 months ago
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files ( #5643 )
4 months ago
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module ( #5275 )
...
revert 97641cd151
4 months ago
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
...
redirects to some non-vichan site
4 months ago
Mike Fährmann
31133b97fb
[nitter] remove instances
4 months ago
Mike Fährmann
ce228ee163
[photobucket] remove module
...
had been broken for years and the new site is payed access only
4 months ago
Mike Fährmann
009aa90c3f
[tests] update extractor results
...
at least some of them
4 months ago
Mike Fährmann
020050ea8b
merge #5641 : [pixeldrain] add support for single file album download
4 months ago
Mike Fährmann
154a890399
[pixeldrain] integrate into 'album' extractor
4 months ago
HornyQT
24e70b956b
[pixeldrain] add support for single file album download
4 months ago
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' ( #5635 )
4 months ago
Mike Fährmann
f651b3b6ab
merge #5601 : [twitter] match '/video/' Tweet URLs
4 months ago
Mike Fährmann
7f1ed909d5
[imgur] match gallery/album/image URLs with title slugs ( #5593 )
4 months ago
Delphox
8ba73e2ec9
[twitter] match /video/ tweet urls
4 months ago
Mike Fährmann
2ee9ffeed6
merge #5568 : [furaffinity] match 'xfuraffinity' URLs
4 months ago
Delphox
11109d5bad
[furaffinity] match xfuraffinity.com
5 months ago
Mike Fährmann
699592498b
[tests] use random port number for local HTTP server
...
… and explicitly bind to 127.0.0.1 instead of all interfaces
5 months ago
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor ( #5341 )
5 months ago
Mike Fährmann
d0cead105b
[formatter] allow dots etc in '…' literals ( #5539 )
...
don't parse fields starting with '
this disables the ability to directly apply […] to '…' literals,
but that's not really useful anyway and can still be done with _lit
5 months ago
Mike Fährmann
8ed70b3256
[tests] mark tests with missing auth as 'only_matching'
...
… instead of skipping them completely
5 months ago
Mike Fährmann
3cf5366143
[mastodon] add support for card images
5 months ago
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors ( #5529 )
5 months ago
Mike Fährmann
6c57958806
merge #5511 : [twitter] [furaffinity] match fixvx.com and fxfuraffinity/fxraffinity.net URLs
5 months ago
Delphox
1886721d82
update tests
5 months ago
Mike Fährmann
cd241bea0a
[downloader:http] add MIME type and signature for .m4v files ( #5505 )
5 months ago
Mike Fährmann
068ccfe0b3
[tests] allow filtering extractor result tests by URL or comment
...
python test_results.py twitter:+/i/web/
python test_results.py twitter:~twitpic
5 months ago
Mike Fährmann
c9d3b5e5d9
[pixiv] change 'sanity_level' debug message to a warning ( #5180 )
5 months ago
Mike Fährmann
257e9fb435
[gelbooru] improve pagination logic for meta tags ( #5478 )
...
similar to 494acabd38
5 months ago
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor ( #5306 )
5 months ago
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option ( #5373 )
5 months ago
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis
5 months ago
Mike Fährmann
40c1a8e471
[wikimedia] fix exception for files with empty 'metadata'
5 months ago
Mike Fährmann
0e730ba980
[pp:mtime] do not overwrite '_mtime' for None values ( #5439 )
6 months ago
Mike Fährmann
647a87d17c
[twitter] match '/photo/' Tweet URLs ( #5443 )
...
fixes regression introduced in 40c05535
6 months ago
Mike Fährmann
40bd145637
remove 'contextlib' imports
6 months ago
Mike Fährmann
9a8403917a
restore LD_LIBRARY_PATH for PyInstaller builds ( #5421 )
6 months ago
Mike Fährmann
095e5ded6f
[reddit] support comment embeds ( #5366 )
6 months ago
Mike Fährmann
64948f2c09
[foolfuuka] improve 'board' pattern & support pages ( #5408 )
6 months ago
Mike Fährmann
ef0c90414c
[wikimedia] suppress exception for entries without 'imageinfo' ( #5384 )
6 months ago
Mike Fährmann
9cce461627
[kemonoparty] add 'announcements' option ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2015919188
6 months ago
Mike Fährmann
72ac2c750d
[kemonoparty:favorite] support 'sort' and 'order' query params ( #5375 )
6 months ago
Mike Fährmann
d1d017ab5d
merge #5372 : [twitter] match Tweet URLs with query parameters ( #5371 )
...
fixes regression introduced in 40c05535
6 months ago
fireattack
423599ce95
[twitter] fix pattern for single tweet ( #5371 )
...
- Add optional slash
- Update tests to include some non-standard tweet URLs
6 months ago
Mike Fährmann
15a4bc2584
[kemonoparty] fix KeyError for empty files ( #5368 )
6 months ago
Mike Fährmann
31e7ca73b6
[gelbooru] add 'order-posts' option for favorites ( #5220 )
6 months ago
Mike Fährmann
55e8fdad29
[tests] use 'datetime.timezone.utc' instead of 'datetime.UTC'
...
'datetime.UTC' was added in Python 3.11
and is not defined in older versions.
6 months ago
Mike Fährmann
4b6f47e571
[pornhub:gif] extract 'viewkey' and 'timestamp' metadata ( #4463 )
...
https://github.com/mikf/gallery-dl/issues/4463#issuecomment-2014550302
6 months ago
Mike Fährmann
7a7dc442a0
[tests] update extractor results
6 months ago
Mike Fährmann
1d6260f456
[bunkr] remove 'description' metadata
...
album descriptions are no longer available on album pages
and the previous code erroneously returned just '0'
6 months ago
Mike Fährmann
32262a048b
[idolcomplex] fix metadata extraction
...
- replace legacy 'id' vales with alphanumeric ones, since the former are
no longer available
- approximate 'vote_average', since the real value is no longer
available
- fix 'vote_count'
6 months ago
Mike Fährmann
ddb2edfd32
[formatter] fix local DST datetime offsets for ':O'
...
'O' would get the *current* local UTC offset and apply it to all
'datetime' objects it gets applied to.
This would result in a wrong offset if the current offset includes
DST and the target 'datetime' does not or vice-versa.
'O' now determines the correct local UTC offset while respecting DST for
each individual 'datetime'.
6 months ago
Mike Fährmann
da6ba60331
[bluesky] add 'instance' metadata field ( #4438 )
6 months ago
Mike Fährmann
718c870430
[tests] show full path for nested values
...
'user.name' instead of just 'name' when testing for
"user": { … , "name": "…", … }
6 months ago
Mike Fährmann
26bc2d55f4
[hiperdex] update URL patterns & fix 'manga' metadata ( #5340 )
6 months ago
Mike Fährmann
8e694d85c4
[twitter] add 'birdwatch' metadata field ( #5317 )
...
should probably get a better name,
but this is what it's called internally by Twitter
6 months ago
Mike Fährmann
b8e7be225c
merge #5333 : [imagefap] fix folder extractor
6 months ago
Herp
99c53f7fa8
Fix imagefap extrcator
6 months ago
Mike Fährmann
1418c0ce38
[kemonoparty] add 'revision_count' metadata field ( #5334 )
6 months ago
Mike Fährmann
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs
6 months ago
Mike Fährmann
76683c5f5c
[deviantart:stash] fix 'index' metadata ( #5335 )
6 months ago
Mike Fährmann
108abab537
[twitter] add 'protected' metadata field ( #5327 )
...
for 'author' and 'user'
6 months ago
blankie
225d849139
[mastodon] fix handling null 'moved' account field
6 months ago
Mike Fährmann
ac4e29f70a
[lensdump] support more direct link formats ( #5293 )
7 months ago
Mike Fährmann
d3003f8531
merge #5270 : [imagefap] add 'folder' metadata
7 months ago
Mike Fährmann
05331f9cf1
[imagefap] flake8, cleanup, tests
7 months ago
Mike Fährmann
40c0553523
[twitter] add 'quotes' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924
It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
7 months ago
Mike Fährmann
790c0ffb8d
[lensdump] recognize direct image links ( #5293
7 months ago
Mike Fährmann
6d9e3c0eb1
[skeb] add extractor for followed users ( #5290 )
...
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
7 months ago
Mike Fährmann
ace16f00f5
[weibo] fix retweets ( #2825 , #3874 , #5263 )
...
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
7 months ago
Mike Fährmann
0676a9d6ec
[weibo] fix 'livephoto' filename extensions ( #5287 )
7 months ago
Mike Fährmann
a8027745e3
[downloader:http] add MIME type and signature for .mov files ( #5287 )
7 months ago
Mike Fährmann
24873c2724
[warosu] fix crash for threads with deleted posts ( #5289 )
7 months ago
Mike Fährmann
f296067797
[naver] unescape post 'title' and 'description'
7 months ago
Mike Fährmann
a71cdab53e
merge #5126 : [naver] fix EUC-KR encoding issue in old image URLs
7 months ago
Mike Fährmann
a8d3efbb99
[naver] simplify code + add test
7 months ago
Mike Fährmann
7b28418f69
[naver] recognize '.naver' URLs
...
https://blog.naver.com/PostView.naver ?…
7 months ago
Mike Fährmann
a767832332
[deviantart:avatar] ignore default avatars ( #5276 )
7 months ago
Mike Fährmann
6482bbc525
[bluesky] handle different 'embed' structure
7 months ago
Mike Fährmann
1a9b9aa310
[artstation] support video clips ( #2566 , #3309 , #3911 )
...
- add 'videos' and 'previews' options
- fix 403 errors for video previews
7 months ago
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option ( #4995 )
7 months ago
Mike Fährmann
cf9e99c07b
[artstation] support collections ( #146 )
...
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
7 months ago
Mike Fährmann
32ec695195
merge #5256 : [wikimedia] add azurlane.koumakan.jp
7 months ago
Mike Fährmann
5d9ec91896
[azurlanewiki] supportedsites + test
7 months ago
Mike Fährmann
76581c13f7
handle URLs without '/' after their TLD ( #5252 )
7 months ago
Mike Fährmann
ba062712ad
[tests] '__main__' -> "__main__"
7 months ago
Mike Fährmann
8a11b72253
remove extractor/test.py ( #4504 )
7 months ago