5c1f5861b6
[flickr] add 'contexts' option ( #5324 )
6 months ago
26bc2d55f4
[hiperdex] update URL patterns & fix 'manga' metadata ( #5340 )
6 months ago
8e694d85c4
[twitter] add 'birdwatch' metadata field ( #5317 )
...
should probably get a better name,
but this is what it's called internally by Twitter
6 months ago
b8e7be225c
merge #5333 : [imagefap] fix folder extractor
6 months ago
99c53f7fa8
Fix imagefap extrcator
6 months ago
03a9ce9832
[kemonoparty] add 'order-revisions' option ( #5334 )
6 months ago
1418c0ce38
[kemonoparty] add 'revision_count' metadata field ( #5334 )
6 months ago
ddee5ae7c4
[gofile] fix extraction
6 months ago
5716430c35
[deviantart:stash] recognize 'deviantart.com/stash/…' URLs
6 months ago
76683c5f5c
[deviantart:stash] fix 'index' metadata ( #5335 )
6 months ago
5158cbb4c1
[weibo] rework pagination logic ( #4168 )
...
don't automatically stop when receiving an empty status list
shouldn't improve 'tabtype=feed' results, but at least 'tabtype=album'
ones and others using cursors won't end prematurely
6 months ago
d53db6e11a
[twitter] handle "account is temporarily locked" errors ( #5300 )
...
- display proper error message
- add 'locked' option
6 months ago
108abab537
[twitter] add 'protected' metadata field ( #5327 )
...
for 'author' and 'user'
6 months ago
dde822e69a
[instagram] change 'posts are private' exception to a warning ( #5322 )
6 months ago
e40973118d
merge #5323 : [instagram] default 'likes' to '0'
6 months ago
b188cb2729
merge #5321 : [mastodon] fix handling null 'moved' account field
6 months ago
c210c7a4ed
[instagram] default posts like_count to zero
...
I don't know when/why this happens and for private account reasons can't
add an example here, but i had this error out and it feels like a safe
fix to default to `0` here.
6 months ago
225d849139
[mastodon] fix handling null 'moved' account field
6 months ago
106dfdb4c3
cleanup sleep-request retry delay code
...
more lines but easier to read I'd say
6 months ago
4565de3c8e
[reddit] provide 'gif' and 'mp4' variant fallbacks ( #5315 )
6 months ago
5842e4928d
[imgur] fail downloads when redirected to 'removed.png' ( #5308 )
6 months ago
ac4e29f70a
[lensdump] support more direct link formats ( #5293 )
6 months ago
146459056c
[reddit] provide 'fallback_url' as video fallback ( #5296 )
7 months ago
d3003f8531
merge #5270 : [imagefap] add 'folder' metadata
7 months ago
05331f9cf1
[imagefap] flake8, cleanup, tests
7 months ago
40c0553523
[twitter] add 'quotes' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924
It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
7 months ago
790c0ffb8d
[lensdump] recognize direct image links ( #5293
7 months ago
6d9e3c0eb1
[skeb] add extractor for followed users ( #5290 )
...
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
7 months ago
ace16f00f5
[weibo] fix retweets ( #2825 , #3874 , #5263 )
...
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
7 months ago
0676a9d6ec
[weibo] fix 'livephoto' filename extensions ( #5287 )
7 months ago
db507e30c7
[pixiv] fix novel text extraction ( #5285 )
...
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
7 months ago
296f20e630
[warosu] fix 'board_name' metadata
7 months ago
24873c2724
[warosu] fix crash for threads with deleted posts ( #5289 )
7 months ago
f296067797
[naver] unescape post 'title' and 'description'
7 months ago
a71cdab53e
merge #5126 : [naver] fix EUC-KR encoding issue in old image URLs
7 months ago
a8d3efbb99
[naver] simplify code + add test
7 months ago
f64fb8f239
[naver] EUC-KR encoding issue in old image URLs Fix
...
Around October 2010, the image server URL format and file name
encoding changed from EUC-KR to UTF-8.
Modified to detect old URL format and decode image URLs into EUC-KR
- (lint with flake8) Customize conditions
Wrap lines smaller than 79 characters
- (lint with flake8) Customize conditions (2nd try)
- One import per line
- Indent on consecutive lines
- (lint with flake8) Customize conditions (3rd try)
- E128 continuation line under-indented for visual indent
- E123 closing bracket does not match indentation of opening bracket's line
- Update naver.py
Check encoding for all image URLs
7 months ago
7b28418f69
[naver] recognize '.naver' URLs
...
https://blog.naver.com/PostView.naver ?…
7 months ago
a767832332
[deviantart:avatar] ignore default avatars ( #5276 )
7 months ago
0cbc910905
[deviantart:avatar] fix 'index' for avatars without '?' ( #5276 )
7 months ago
6482bbc525
[bluesky] handle different 'embed' structure
7 months ago
1115dccd0d
[bluesky] fix feeds and lists
...
bug introduced in 495c9ee1
7 months ago
1a9b9aa310
[artstation] support video clips ( #2566 , #3309 , #3911 )
...
- add 'videos' and 'previews' options
- fix 403 errors for video previews
7 months ago
f8b037ed40
[Imagefap] Add folder metadata
...
[Imagefap] Add "folder" metadata when downloading a folder or user profile.
No additional request is made to the server.
Use for example with the following configuration :
"parent-metadata": true
"directory":["{category}", "{uploader}", "{folder}", "{gallery_id} {title}"]
7 months ago
982880615d
[deviantart] prevent unnecessary API requests ( #4995 )
...
… when using 'comments-avatars'
This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
7 months ago
25d2854272
[deviantart] add 'comments-avatars' option ( #4995 )
7 months ago
218ec1a9ee
[instagram] raise proper error for missing 'reels_media' ( #5257 )
7 months ago
82c73c77b0
[redgifs] make 'date' available for directories ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1973975415
7 months ago
cf9e99c07b
[artstation] support collections ( #146 )
...
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
7 months ago
32ec695195
merge #5256 : [wikimedia] add azurlane.koumakan.jp
7 months ago
88a06df165
[wikimedia] add azurlane.koumakan.jp to presets
7 months ago
1db0a587f3
[nitter] ignore invalid Tweets ( #5253 )
...
like "Load newest"
7 months ago
a00b171d4e
[bluesky] wait unitl 'RateLimit-Reset' on 429 responses
7 months ago
7d874e2497
[bluesky] improve API error messages
7 months ago
495c9ee126
[bluesky] add 'reposts' option ( #4438 , #5248 )
7 months ago
c8b591303f
[paheal] cleanup
7 months ago
8a11b72253
remove extractor/test.py ( #4504 )
7 months ago
fde9e25c9f
[tests:kemonoparty] '.party' -> '.su'
7 months ago
311a21bfb2
[bluesky] fix '/follows' not spawning child extractors ( #5246 )
7 months ago
d3dca68225
[xvideos] fix galleries with more than 500 images ( #5244 )
7 months ago
13443f40a3
[xvideos] support '/channels/' URLs ( #5244 )
7 months ago
c60ebc6519
[deviantart] improve fetching extended metadata ( #5175 )
...
use multiple metadata API calls per chunk of deviations if necessary
7 months ago
cc6b9e4c18
[zerochan] use API by default ( #3669 )
...
add 'pagination' option
7 months ago
a2b55d5dde
[skeb] retry 429 responses containing a 'request_key' cookie ( #5210 )
7 months ago
b4c46de4b8
merge #5224 : [artstation] update URL patterns to recognize usernames with dashes
7 months ago
962f55cc68
[artstation] fix handling usernames with dashes
7 months ago
fe7e2281ac
[nijie] increase default delay between requests ( #5221 )
...
1-2s is not enough
7 months ago
a34312e3ac
[instagram] make accessing 'like_count' non-fatal ( #5218 )
7 months ago
741fd00cec
[deviantart] extend 'metadata' option ( #5175 )
...
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'
for example "metadata": "stats,submission"
7 months ago
8a63801311
[vsco] add 'spaces' extractor ( #5202 )
...
for spaces listed on a user page
7 months ago
ccb413df71
[wikimedia] support 'pidgi.net' and 'bulbapedia.bulbagarden.net' ( #5205 , #5206 )
7 months ago
7033cc14e9
[vsco] add 'space' extractor ( #5202 )
7 months ago
770aec922d
[fapachi] ignore empty entries
7 months ago
ee7c054855
[bluesky] add 'search' extractor ( #4438 )
...
Both https://bsky.app/search?q=QUERY and https://bsky.app/search/QUERY
are recognized as search URLs, where QUERY gets forwarded unmodified as
'q' parameter for app.bsky.feed.searchPosts .
User searches are not supported yet.
7 months ago
91e5c4fdfe
[bluesky] add 'avatar' and 'background' extractors ( #4438 )
7 months ago
24c1317e0d
[batoto] fix crash when manga/chapter contains a '-' ( #5200 )
7 months ago
0abd9723af
[bluesky] add 'metadata' option ( #4438 )
...
allow extracting 'user' metadata and
make 'facets' extraction optional
7 months ago
7e036ea290
[bluesky] add 'depth' option ( #4438 )
...
and reduce default depth and parentHeight values
7 months ago
42335ea880
[zerochan] fix skipping every other post
7 months ago
c97b92cc35
[fanbox] add 'home' and 'supporting' extractors ( #5138 )
7 months ago
04e4ffc64c
[deviantart] combine 'png' option with 'quality' ( #4846 )
...
"quality": "png" to download PNGs instead og JPEGs
7 months ago
9cc4ec2c58
[deviantart] add 'png' option ( #4846 )
7 months ago
966c8608e6
[deviantart] move image content extraction into separate function
7 months ago
1d1ffe3317
[pornpics] update 'channel' extraction & add test
...
change 'channel' to a list, since extracting both 'channel' and
'channels' does not really work with text.extract_from()
7 months ago
32472d7d6c
Add support for multi channels
7 months ago
139ff3f6ab
[kemonoparty] add 'posts' extractor ( #5194 )
7 months ago
814ad9321e
[deviantart] skip locked/blurred posts ( #4567 , #5193 )
7 months ago
f7f8ef8684
[twitter] support communities ( #4913 )
7 months ago
cae77e85f8
[twitter] update query hashes
...
... as well as 'variables' and 'features' values
also remove unused legacy API code
7 months ago
06cb518d97
[bunkr] fix extraction ( #5088 , #5151 , #5153 )
...
- remove legacy code
- map legacy domains to bunkr.sk
- use input URL domain for newer domains
- update tests (some files got slightly modified or deleted)
7 months ago
dcc6e3f65c
merge #5134 : [bunkr] add new bunkr domains ( #5130 )
7 months ago
4641937ca3
[imagetwist] add 'gallery' extractor ( #5190 )
7 months ago
fde82ab0ce
[imagechest] add 'user' extractor ( #5143 )
7 months ago
4474cea31b
merge #5187 : [skeb] add 'num' and 'count' metadata fields
7 months ago
4cfceb23cb
[skeb] rename 'data' -> 'file' & add tests
7 months ago
c83d0a1596
[weibo] add 'gifs' option ( #5183 )
7 months ago
f9a8e8cacf
[skeb] add 'num' and 'count' metadata fields
7 months ago
af61d2b037
[wikimedia] combine most wikimedia.org sites ( #1443 )
...
add wikidata.org and wikivoyage.org
7 months ago
c7d17f1111
[bluesky] extract 'hashtags', 'mentions', and 'uris' metadata ( #4438 )
7 months ago
55bbd49a0e
[bluesky] download images in original resolution ( #4438 )
...
at least up to 2000 px
7 months ago
Mike Fährmann