Mike Fährmann
226ead728e
[agnph] add 'tag' and 'post' extractors ( #5284 , #5890 )
2 months ago
Mike Fährmann
d7a2c73274
[util] let a CustomNone instance be equal to itself
2 months ago
Mike Fährmann
b5e141ed6e
[sankakucomplex] update domain to 'news.sankakucomplex.com'
2 months ago
Mike Fährmann
f321272b7c
[ytdl] fix --cookies-from-browser option parsing
2 months ago
Mike Fährmann
5207a0c2e0
[zerochan] implement 'tags' option ( #5874 )
...
allow splitting tags into separate lists by category
2 months ago
Mike Fährmann
1aadc29c5b
[zerochan] fix 'source' extraction
2 months ago
Mike Fährmann
5f6d20c595
[tests] remove internal extractor check
...
revert 60a2fefedd
.
2 months ago
Mike Fährmann
3eba1f7c29
[tests] load results from ${GDL_TEST_RESULTS} ( #5262 )
2 months ago
Mike Fährmann
db9833c28a
merge #5870 : [aryion] add 'favorite' extractor ( #4511 )
2 months ago
Mike Fährmann
156a70bec0
[aryion] update favorite extractor
...
- add test case
- add docs/supportedsites entry
- add custom directory_fmt and archive_fmt
- remove constructor
- appease flake8
2 months ago
Mike Fährmann
727e53f513
[bunkr] support 'bunkr.fi' URLs ( #5872 )
2 months ago
Mike Fährmann
287a7d13cf
[sankaku] implement 'notes' extraction ( #5865 )
2 months ago
Mike Fährmann
026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2 months ago
Mike Fährmann
60a2fefedd
[tests] restrict 'test_unique_pattern_matches' to internal extractors
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2 months ago
Mike Fährmann
3fa74ca4d7
[tests] enable test results for external extractors ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2231649983
2 months ago
Mike Fährmann
f7383a56f8
wrap filters/conditionals in a try-except block
...
allows accessing undefined fields without exception or locals().get(…)
but hides mistakes/typos/etc by evaluating to False without feedback
performance loss compared to the previous version without try-except
is negligible (~20ns for me)
2 months ago
Mike Fährmann
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2 months ago
Mike Fährmann
21831eba1e
[tests] completely ignore '#auth' for 'only_matching' tests
2 months ago
Mike Fährmann
1527ad79e2
[tests] fix syntax for Python < 3.6
...
no f-strings
3 months ago
Mike Fährmann
da9916c01f
[pp:metadata] implement format strings for 'directory' ( #5728 )
3 months ago
Mike Fährmann
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
3 months ago
Nicholas Bishop
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
3 months ago
Mike Fährmann
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
3 months ago
Mike Fährmann
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
3 months ago
Mike Fährmann
51fdfbe6fc
[erome] extract 'date' metadata ( #5796 )
3 months ago
Mike Fährmann
8f50c04af2
[formatter] implement 'X' format specifier ( #5770 )
3 months ago
enduser420
5adbfe526d
[tcbscans] support other domains
3 months ago
Mike Fährmann
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
3 months ago
Mike Fährmann
8452d04a33
[fanbox] handle KeyError for no longer existing plans ( #5759 )
...
return the plan of the next higher tier instead
3 months ago
Mike Fährmann
ae3706286a
[speakerdeck] inherit from GalleryExtractor
3 months ago
Mike Fährmann
9c65db2a92
consistent 'with open(…) as fp:' syntax
3 months ago
Mike Fährmann
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
3 months ago
Mike Fährmann
86f0c3baaf
[szurubooru] support empty tag searches ( #5711 )
3 months ago
Mike Fährmann
2e11b6e756
[nijie] support downloading videos ( #5707 , #5617 )
3 months ago
Mike Fährmann
f160859c5c
[hitomi] extract 'title_jpn' metadata ( #5706 )
3 months ago
Mike Fährmann
9abeab5ecf
[shimmie2] support 'vidya.pics' ( #5632 )
4 months ago
Mike Fährmann
7614bc458e
[util] extend CustomNone with comparison operators
4 months ago
Mike Fährmann
1ce5de0290
[formatter] implement 'C' format specifier ( #5647 )
...
to apply a conversion after ':' or
to apply multiple conversions
for example {tags:CSl} or {tags:J - /Cl}
to convert list to string and lowercase it
4 months ago
Mike Fährmann
9b99d2c886
[philomena] support downloading SVG files ( #5643 )
4 months ago
Mike Fährmann
8fce9ea6d5
[hentainexus] restore module ( #5275 )
...
revert 97641cd151
4 months ago
Mike Fährmann
4d11cd9ffb
[vichan] remove 'wikieat.club'
...
redirects to some non-vichan site
4 months ago
Mike Fährmann
31133b97fb
[nitter] remove instances
4 months ago
Mike Fährmann
ce228ee163
[photobucket] remove module
...
had been broken for years and the new site is payed access only
4 months ago
Mike Fährmann
009aa90c3f
[tests] update extractor results
...
at least some of them
4 months ago
Mike Fährmann
020050ea8b
merge #5641 : [pixeldrain] add support for single file album download
4 months ago
Mike Fährmann
154a890399
[pixeldrain] integrate into 'album' extractor
4 months ago
HornyQT
24e70b956b
[pixeldrain] add support for single file album download
4 months ago
Mike Fährmann
0761b22a7f
[hiperdex] update domain to 'hiperdex.top' ( #5635 )
4 months ago
Mike Fährmann
f651b3b6ab
merge #5601 : [twitter] match '/video/' Tweet URLs
4 months ago
Mike Fährmann
7f1ed909d5
[imgur] match gallery/album/image URLs with title slugs ( #5593 )
4 months ago
Delphox
8ba73e2ec9
[twitter] match /video/ tweet urls
4 months ago
Mike Fährmann
2ee9ffeed6
merge #5568 : [furaffinity] match 'xfuraffinity' URLs
4 months ago
Delphox
11109d5bad
[furaffinity] match xfuraffinity.com
4 months ago
Mike Fährmann
699592498b
[tests] use random port number for local HTTP server
...
… and explicitly bind to 127.0.0.1 instead of all interfaces
5 months ago
Mike Fährmann
bd8e4797e5
[vsco] add 'avatar' extractor ( #5341 )
5 months ago
Mike Fährmann
d0cead105b
[formatter] allow dots etc in '…' literals ( #5539 )
...
don't parse fields starting with '
this disables the ability to directly apply […] to '…' literals,
but that's not really useful anyway and can still be done with _lit
5 months ago
Mike Fährmann
8ed70b3256
[tests] mark tests with missing auth as 'only_matching'
...
… instead of skipping them completely
5 months ago
Mike Fährmann
3cf5366143
[mastodon] add support for card images
5 months ago
Mike Fährmann
9b1995dda3
[mastodon] add 'favorite', 'list', and 'hashtag' extractors ( #5529 )
5 months ago
Mike Fährmann
6c57958806
merge #5511 : [twitter] [furaffinity] match fixvx.com and fxfuraffinity/fxraffinity.net URLs
5 months ago
Delphox
1886721d82
update tests
5 months ago
Mike Fährmann
cd241bea0a
[downloader:http] add MIME type and signature for .m4v files ( #5505 )
5 months ago
Mike Fährmann
068ccfe0b3
[tests] allow filtering extractor result tests by URL or comment
...
python test_results.py twitter:+/i/web/
python test_results.py twitter:~twitpic
5 months ago
Mike Fährmann
c9d3b5e5d9
[pixiv] change 'sanity_level' debug message to a warning ( #5180 )
5 months ago
Mike Fährmann
257e9fb435
[gelbooru] improve pagination logic for meta tags ( #5478 )
...
similar to 494acabd38
5 months ago
Mike Fährmann
e02d2ff45d
[tapas] add 'creator' extractor ( #5306 )
5 months ago
Mike Fährmann
35d4a706ae
[pixiv:novel] add 'covers' option ( #5373 )
5 months ago
Mike Fährmann
b57051719f
[wikimedia] support wiki.gg wikis
5 months ago
Mike Fährmann
40c1a8e471
[wikimedia] fix exception for files with empty 'metadata'
5 months ago
Mike Fährmann
0e730ba980
[pp:mtime] do not overwrite '_mtime' for None values ( #5439 )
6 months ago
Mike Fährmann
647a87d17c
[twitter] match '/photo/' Tweet URLs ( #5443 )
...
fixes regression introduced in 40c05535
6 months ago
Mike Fährmann
40bd145637
remove 'contextlib' imports
6 months ago
Mike Fährmann
9a8403917a
restore LD_LIBRARY_PATH for PyInstaller builds ( #5421 )
6 months ago
Mike Fährmann
095e5ded6f
[reddit] support comment embeds ( #5366 )
6 months ago
Mike Fährmann
64948f2c09
[foolfuuka] improve 'board' pattern & support pages ( #5408 )
6 months ago
Mike Fährmann
ef0c90414c
[wikimedia] suppress exception for entries without 'imageinfo' ( #5384 )
6 months ago
Mike Fährmann
9cce461627
[kemonoparty] add 'announcements' option ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2015919188
6 months ago
Mike Fährmann
72ac2c750d
[kemonoparty:favorite] support 'sort' and 'order' query params ( #5375 )
6 months ago
Mike Fährmann
d1d017ab5d
merge #5372 : [twitter] match Tweet URLs with query parameters ( #5371 )
...
fixes regression introduced in 40c05535
6 months ago
fireattack
423599ce95
[twitter] fix pattern for single tweet ( #5371 )
...
- Add optional slash
- Update tests to include some non-standard tweet URLs
6 months ago
Mike Fährmann
15a4bc2584
[kemonoparty] fix KeyError for empty files ( #5368 )
6 months ago
Mike Fährmann
31e7ca73b6
[gelbooru] add 'order-posts' option for favorites ( #5220 )
6 months ago
Mike Fährmann
55e8fdad29
[tests] use 'datetime.timezone.utc' instead of 'datetime.UTC'
...
'datetime.UTC' was added in Python 3.11
and is not defined in older versions.
6 months ago
Mike Fährmann
4b6f47e571
[pornhub:gif] extract 'viewkey' and 'timestamp' metadata ( #4463 )
...
https://github.com/mikf/gallery-dl/issues/4463#issuecomment-2014550302
6 months ago
Mike Fährmann
7a7dc442a0
[tests] update extractor results
6 months ago
Mike Fährmann
1d6260f456
[bunkr] remove 'description' metadata
...
album descriptions are no longer available on album pages
and the previous code erroneously returned just '0'
6 months ago
Mike Fährmann
32262a048b
[idolcomplex] fix metadata extraction
...
- replace legacy 'id' vales with alphanumeric ones, since the former are
no longer available
- approximate 'vote_average', since the real value is no longer
available
- fix 'vote_count'
6 months ago
Mike Fährmann
ddb2edfd32
[formatter] fix local DST datetime offsets for ':O'
...
'O' would get the *current* local UTC offset and apply it to all
'datetime' objects it gets applied to.
This would result in a wrong offset if the current offset includes
DST and the target 'datetime' does not or vice-versa.
'O' now determines the correct local UTC offset while respecting DST for
each individual 'datetime'.
6 months ago
Mike Fährmann
da6ba60331
[bluesky] add 'instance' metadata field ( #4438 )
6 months ago
Mike Fährmann
718c870430
[tests] show full path for nested values
...
'user.name' instead of just 'name' when testing for
"user": { … , "name": "…", … }
6 months ago
Mike Fährmann
26bc2d55f4
[hiperdex] update URL patterns & fix 'manga' metadata ( #5340 )
6 months ago
Mike Fährmann
8e694d85c4
[twitter] add 'birdwatch' metadata field ( #5317 )
...
should probably get a better name,
but this is what it's called internally by Twitter
6 months ago
Mike Fährmann
b8e7be225c
merge #5333 : [imagefap] fix folder extractor
6 months ago
Herp
99c53f7fa8
Fix imagefap extrcator
6 months ago
Mike Fährmann
1418c0ce38
[kemonoparty] add 'revision_count' metadata field ( #5334 )
6 months ago
Mike Fährmann
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs
6 months ago
Mike Fährmann
76683c5f5c
[deviantart:stash] fix 'index' metadata ( #5335 )
6 months ago
Mike Fährmann
108abab537
[twitter] add 'protected' metadata field ( #5327 )
...
for 'author' and 'user'
6 months ago
blankie
225d849139
[mastodon] fix handling null 'moved' account field
6 months ago
Mike Fährmann
ac4e29f70a
[lensdump] support more direct link formats ( #5293 )
6 months ago