Mike Fährmann
f296067797
[naver] unescape post 'title' and 'description'
7 months ago
Mike Fährmann
a71cdab53e
merge #5126 : [naver] fix EUC-KR encoding issue in old image URLs
7 months ago
Mike Fährmann
a8d3efbb99
[naver] simplify code + add test
7 months ago
Mike Fährmann
7b28418f69
[naver] recognize '.naver' URLs
...
https://blog.naver.com/PostView.naver ?…
7 months ago
Mike Fährmann
a767832332
[deviantart:avatar] ignore default avatars ( #5276 )
7 months ago
Mike Fährmann
6482bbc525
[bluesky] handle different 'embed' structure
7 months ago
Mike Fährmann
1a9b9aa310
[artstation] support video clips ( #2566 , #3309 , #3911 )
...
- add 'videos' and 'previews' options
- fix 403 errors for video previews
7 months ago
Mike Fährmann
25d2854272
[deviantart] add 'comments-avatars' option ( #4995 )
7 months ago
Mike Fährmann
cf9e99c07b
[artstation] support collections ( #146 )
...
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
7 months ago
Mike Fährmann
32ec695195
merge #5256 : [wikimedia] add azurlane.koumakan.jp
7 months ago
Mike Fährmann
5d9ec91896
[azurlanewiki] supportedsites + test
7 months ago
Mike Fährmann
76581c13f7
handle URLs without '/' after their TLD ( #5252 )
7 months ago
Mike Fährmann
ba062712ad
[tests] '__main__' -> "__main__"
7 months ago
Mike Fährmann
8a11b72253
remove extractor/test.py ( #4504 )
7 months ago
Mike Fährmann
fde9e25c9f
[tests:kemonoparty] '.party' -> '.su'
7 months ago
Mike Fährmann
13443f40a3
[xvideos] support '/channels/' URLs ( #5244 )
7 months ago
Mike Fährmann
cc6b9e4c18
[zerochan] use API by default ( #3669 )
...
add 'pagination' option
7 months ago
blankie
962f55cc68
[artstation] fix handling usernames with dashes
7 months ago
Mike Fährmann
741fd00cec
[deviantart] extend 'metadata' option ( #5175 )
...
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'
for example "metadata": "stats,submission"
7 months ago
Mike Fährmann
8a63801311
[vsco] add 'spaces' extractor ( #5202 )
...
for spaces listed on a user page
7 months ago
Mike Fährmann
ccb413df71
[wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' ( #5205 , #5206 )
7 months ago
Mike Fährmann
7033cc14e9
[vsco] add 'space' extractor ( #5202 )
7 months ago
Mike Fährmann
c9efccc959
[tests] update extractor results
7 months ago
Mike Fährmann
c413834dfc
[bluesky] extend tests
7 months ago
Mike Fährmann
24c1317e0d
[batoto] fix crash when manga/chapter contains a '-' ( #5200 )
7 months ago
Mike Fährmann
0abd9723af
[bluesky] add 'metadata' option ( #4438 )
...
allow extracting 'user' metadata and
make 'facets' extraction optional
7 months ago
Mike Fährmann
c97b92cc35
[fanbox] add 'home' and 'supporting' extractors ( #5138 )
7 months ago
Mike Fährmann
04e4ffc64c
[deviantart] combine 'png' option with 'quality' ( #4846 )
...
"quality": "png" to download PNGs instead og JPEGs
7 months ago
Mike Fährmann
9cc4ec2c58
[deviantart] add 'png' option ( #4846 )
7 months ago
Mike Fährmann
1d1ffe3317
[pornpics] update 'channel' extraction & add test
...
change 'channel' to a list, since extracting both 'channel' and
'channels' does not really work with text.extract_from()
7 months ago
Mike Fährmann
139ff3f6ab
[kemonoparty] add 'posts' extractor ( #5194 )
7 months ago
Mike Fährmann
814ad9321e
[deviantart] skip locked/blurred posts ( #4567 , #5193 )
7 months ago
Mike Fährmann
f7f8ef8684
[twitter] support communities ( #4913 )
7 months ago
Mike Fährmann
8f27f43d4d
[tests] implement explicitly disabling auth
7 months ago
Mike Fährmann
06cb518d97
[bunkr] fix extraction ( #5088 , #5151 , #5153 )
...
- remove legacy code
- map legacy domains to bunkr.sk
- use input URL domain for newer domains
- update tests (some files got slightly modified or deleted)
7 months ago
Mike Fährmann
4641937ca3
[imagetwist] add 'gallery' extractor ( #5190 )
7 months ago
Mike Fährmann
fde82ab0ce
[imagechest] add 'user' extractor ( #5143 )
7 months ago
Mike Fährmann
4474cea31b
merge #5187 : [skeb] add 'num' and 'count' metadata fields
7 months ago
Mike Fährmann
4cfceb23cb
[skeb] rename 'data' -> 'file' & add tests
7 months ago
Mike Fährmann
c83d0a1596
[weibo] add 'gifs' option ( #5183 )
7 months ago
Mike Fährmann
af61d2b037
[wikimedia] combine most wikimedia.org sites ( #1443 )
...
add wikidata.org and wikivoyage.org
7 months ago
Mike Fährmann
c7d17f1111
[bluesky] extract 'hashtags', 'mentions', and 'uris' metadata ( #4438 )
7 months ago
Mike Fährmann
55bbd49a0e
[bluesky] download images in original resolution ( #4438 )
...
at least up to 2000 px
7 months ago
Mike Fährmann
aee5580c62
[idolcomplex] extract 'id_alnum' metadata ( #5171 )
7 months ago
Mike Fährmann
cf7d6be2d4
[bluesky] initial support ( #4438 , #4708 , #4722 , #5047 )
8 months ago
Mike Fährmann
6ef143ea31
[idolcomplex] support alphanumeric post IDs ( #5171 )
8 months ago
Mike Fährmann
d7823b9f81
[pinterest] fix section URLs for boards with /?# in name ( #5104 )
8 months ago
Mike Fährmann
de752eb7b1
[naverwebtoon] support '/webtoon/' paths for all comics ( #5123 )
8 months ago
Mike Fährmann
22647c2626
[naverwebtoon] fix 'title' for comics with empty tags ( #5120 )
8 months ago
Mike Fährmann
1f7101d606
[archivedmoe] fix thebarchive webm URLs ( #5116 )
8 months ago
Mike Fährmann
34a4ddc399
[sankaku] add 'id-format' option ( #5073 )
8 months ago
Mike Fährmann
afd20ef42c
[kemonoparty] implement filtering duplicate revisions ( #5013 )
...
set 'revisions' to '"unique"' to have it ignore duplicate revisions
8 months ago
Mike Fährmann
c28475d325
[kemonoparty] fix deleting 'name' in orginal objects ( #5103 )
...
... when computing 'revision_hash'
regression caused by 3d68eda4
dict.copy() only creates a shallow copy
I know that and still managed to get I wrong ...
8 months ago
Mike Fährmann
beacfa7436
[bunkr] update domain to 'bunkr.sk' ( #5114 )
8 months ago
Mike Fährmann
0d3af0d35b
[tests] ignore 'ytdl' categories when import fails ( #5095 )
8 months ago
Mike Fährmann
f3ad91b44f
[bunkr] update domain ( #5088 )
8 months ago
Mike Fährmann
c7a42880ab
[wikimedia] support fandom wikis ( #1443 , #2677 , #3378 )
...
Wikis hosted on fandom.com are just wikimedia instances
and support its API.
8 months ago
blankie
df718887c2
[webtoons] fix extracting comic and episode name with commas
8 months ago
Mike Fährmann
0d367ce1b9
[tests] update extractor results
8 months ago
Mike Fährmann
9ca6117c67
[hbrowse] remove module
...
website gone
8 months ago
Mike Fährmann
375eefb886
[chevereto] remove 'pixl.li'
...
"Pixl is closing down"
"All images will be deleted January 1st."
8 months ago
Mike Fährmann
b0a441f1e3
[nitter] remove 'nitter.lacontrevoie.fr'
...
"Fermeture de Nitter / Closing down Nitter"
8 months ago
Mike Fährmann
a1c1e80f67
[giantessbooru] update domain
8 months ago
Mike Fährmann
2007cb2f59
[tests] check extractor category values
8 months ago
Mike Fährmann
93b4120e77
[gelbooru] support 'all' and empty tag ( #5076 )
8 months ago
Mike Fährmann
a416d4c3d5
[sankaku] support post URLs with alphanumeric IDs ( #5073 )
8 months ago
Mike Fährmann
ea553a1d55
[wikimedia] generalize ( #1443 )
...
- support mediawiki.org
- support mariowiki.com (#3660 )
- combine code into a single extractor
(use prefix as subcategory)
- handle non-wiki instances
- unescape titles
8 months ago
Mike Fährmann
c3c1635ef3
[wikimedia] update
...
- rewrite using BaseExtractor
- support most Wiki* domains
- update docs/supportedsites
- add tests
8 months ago
Mike Fährmann
3d68eda4ab
[kemonoparty] add 'revision_hash' metadata ( #4706 , #4727 , #5013 )
...
A SHA1 hexdigest of other relevant metadata fields like
title, content, file and attachment URLs.
This value does NOT reflect which revisions are listed on the website.
Neither does 'edited' or any other metadata field (combinations).
8 months ago
Mike Fährmann
799a8206ad
merge #5061 : [webtoons] extract more metadata
...
- author_name
- comic_name
- episode_name
- username
8 months ago
Mike Fährmann
8ffa0cd3c8
[webtoons] small optimization
...
don't extract the entire 'author_area' and
avoid creating a second 'text.extract_from()' object
8 months ago
Mike Fährmann
68196589c4
[2ch] update
...
- simplify extractor code
- more metadata
- add tests
8 months ago
Mike Fährmann
69726fc82c
[tests] skip tests requiring auth when non is provided
8 months ago
blankie
bb446b1598
[webtoons] extract more metadata
8 months ago
Mike Fährmann
355b909f46
merge #5041 : [steamgriddb] add support ( #5033 )
8 months ago
Mike Fährmann
71e2c3e5a2
merge #5037 : [hatenablog] add support ( #5036 )
8 months ago
Mike Fährmann
b97af09e03
[tests] include URL in failure report
8 months ago
Mike Fährmann
58e0665fbc
[tests] load config from external file
8 months ago
Mike Fährmann
2dcfb012ea
[patreon] download 'm3u8' manifests with ytdl
8 months ago
Mike Fährmann
2191e29e14
[nijie] fix image URL for single image posts ( #5049 )
8 months ago
Mike Fährmann
39904c9e4e
[deviantart:avatar] add 'formats' option ( #4995 )
8 months ago
Mike Fährmann
887ade30a5
[batoto] support more mirror domains ( #5042 )
8 months ago
blankie
2ccb7d3bd3
[steamgriddb] add support
9 months ago
blankie
2cfe788f93
[hatenablog] fix extractor naming errors
9 months ago
blankie
61f3b2f820
[hatenablog] add support
9 months ago
Mike Fährmann
657ed93a22
[batoto] improve v2 manga URL pattern
...
and add tests
9 months ago
Mike Fährmann
33f228756a
[mangadex] add 'list' extractor ( #5025 )
...
supports listing manga and chapters from list feed
9 months ago
Mike Fährmann
c25bdbae91
[komikcast] fix 'manga' extractor ( #5027 )
9 months ago
Mike Fährmann
8e1a2b5446
[komikcast] update domain to 'komikcast.lol' ( #5027 )
9 months ago
Mike Fährmann
a441249ea2
merge #4979 : [batoto] add 'chapter' and 'manga' extractors ( #1434 , #2111 )
9 months ago
Mike Fährmann
b11c352d66
[bato] rename to 'batoto'
...
to use the same category name as the previous bato.to site
9 months ago
Mike Fährmann
3aa24c3744
[bato] simplify and update
9 months ago
Mike Fährmann
11150a7d72
[nudecollect] remove module
9 months ago
Mike Fährmann
c158927c38
merge #5016 : [zzup] add 'gallery' extractor ( #4517 , #4604 , #4659 , #4863 )
9 months ago
Mike Fährmann
217fa7f8a1
include 'test/results' in flake8 checks
9 months ago
Mike Fährmann
e61f016465
[szurubooru] support 'snootbooru.com' ( #5023 )
9 months ago
Mike Fährmann
b4bcf40278
[weibo] fix AttributeError in 'user' extractor ( #5022 )
...
yet another bug caused by a383eca7
9 months ago
Mike Fährmann
0ab0a10d2d
[jpgfish] update domain
9 months ago
enduser420
0f30136109
[zzup] add 'gallery' extractor
9 months ago
Mike Fährmann
7eaf648f2e
[fanbox] add 'metadata' option ( #4921 )
...
extracts 'plan' and extended 'user' metadata
9 months ago