026e0b97db
merge #5824 : [furaffinity] add 'folders' and 'thumbnail' ( #1284 )
2 months ago
9a8ec95398
[furaffinity] improve
2 months ago
6940ad0e72
[booru] allow multiple 'url' keys ( #5859 )
2 months ago
bf44add132
[booru] prevent crash when file URL is empty ( #5859 )
...
- catch all exceptions, including IndexError, and not just a select few
- change logging message level to warning
2 months ago
51fd14f87d
[gelbooru_v02] use total number of posts as end marker ( #5830 )
...
… and potentially retry on empty responses
2 months ago
6110e3f940
[common] fix Logger names of BaseCategory extractors
...
update of d11ec0090c178846
2 months ago
668219b36e
[exhentai] improve error message when temporarily banned ( #5845 )
2 months ago
c83c812a1e
[instagram][twitter] rename 'profile' to 'info' ( #5262 , #3623 )
2 months ago
16e276fca4
[nijie] fix image URLs for single image posts ( #5842 )
...
fixes regression introduced in 2e11b6e7
2 months ago
eb3ef13d28
include 'zstd' in Accept-Encoding header when supported
...
… and slightly update optional dependency list
2 months ago
8aca0e6970
update default User-Agent header to Firefox 128 ESR
2 months ago
8e747b6dee
[twitter] send initial 'cursor' only when given via option
2 months ago
ff39d28ef4
[twitter] fix 'user' when providing 'cursor' ( #5833 )
2 months ago
65385e09cb
[twitter] remove break ( #5831 )
2 months ago
8f3f061daf
[hentainexus] fix error for spread pages ( #5827 )
3 months ago
b376fa814e
[zerochan] handle "KeyError - 'items'" ( #5826 )
...
Zerochan sometimes sends an empty response when there are no more
accessible posts to be had.
3 months ago
97a50a23d2
[twitter] implement 'cursor' support ( #5753 )
3 months ago
4f3be2f571
Remove leftover split() statement
...
Forgot to remove this from a previous implementation attempt
3 months ago
162756b684
[toyhouse] fix Content Warning bypass ( #5820 )
3 months ago
f43bccb5be
[furaffinity] Add 'thumbnail' ( #1284 ) and 'folders' properties
...
Retrieve 'thumbnail' and 'folders' properties for each post.
'thumbnail' (#1284 ):
- Preview image used for search results, writing posts, music, etc.
- Filename format: <post_id>@600-<directory_containing_full_image>.jpg
'Folders' (related to #1817 ):
- A list of all gallery folders containing this post
- Folder name format: [<folder_category> - ]<folder_name>
- Only works on new layout; old layout does not show folders, so list will be empty
A test is included for each property.
3 months ago
d10bfa9065
[vipergirls] improve 'thread' URL pattern
...
allow for query parameters and fragments at tne end of URLs
3 months ago
29eb535e18
merge #5802 : [twitter] extract 'bookmark_count' and 'view_count'
3 months ago
ee93dfeb8d
Add `bookmark_count` and `view_count` to the X / Twitter extractor
...
- Parse `view_count` as integer in Twitter extractor
- Style fix
- optimize 'view_count' extraction
3 months ago
c2bf4ff99c
[twitter] add 'profile' extractor ( #3623 )
3 months ago
44896b0296
[instagram] add 'profile' extractor ( #5262 )
...
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-2188915210
3 months ago
51fdfbe6fc
[erome] extract 'date' metadata ( #5796 )
3 months ago
9329c30b41
merge #5783 : [subscribestar] fix 'date' parsing in updated posts
3 months ago
03486599af
Fix subscribestar date parsing in udated posts
3 months ago
0bb8831853
[twitter] fix 'username-alt' option name ( #5715 )
3 months ago
606202fb04
[fanbox] remove debug code ( #5759 )
3 months ago
b707b31264
merge #5774 : [tcbscans] support other domains
3 months ago
ad25be3420
[fanbox] fix 8452d04a ( #5759 )
...
The previous code would raise an exception when there are no or
more than 1 plans with a fee higher than 'feeRequired'.
3 months ago
5adbfe526d
[tcbscans] support other domains
3 months ago
f58b0e6fc7
[twitter] ignore 'Unavailable' media ( #5736 )
...
… including geo-restricted content.
add 'unavailable' option to allow re-enabling them again
3 months ago
8452d04a33
[fanbox] handle KeyError for no longer existing plans ( #5759 )
...
return the plan of the next higher tier instead
3 months ago
11421cf940
[skeb] fix '429 Too Many Requests' errors ( #5766 )
...
Introduce '_handle_429' method to make it easier for Extractors to react
to 429 errors regardless of 'sleep-429' settings.
3 months ago
60b4541199
improve a1bb3279, fix oauth:pixiv ( #5757 )
...
Check 'input' option only when required.
This also fixes an exception in oauth:pixiv caused by using the same
'_input' name as a method defined there.
3 months ago
a1bb32792b
do not try to read from stdin when it is non-interactive ( #5733 )
...
add '--no-input' command-line option and 'input' config file option
to allow users to manually configure this
3 months ago
ae3706286a
[speakerdeck] inherit from GalleryExtractor
3 months ago
a92c0bef96
merge #5730 : [speakerdeck] fix extraction
3 months ago
f272b5d2ac
fix: extractor for speakerdeck.com
3 months ago
c699ce8ebb
[twitter] add 'username-alt' option ( #5715 )
3 months ago
c6fc0281e8
[newgrounds] extend 'format' option ( #5709 )
...
- check more extensions for original formats (mp4, webm, m4v, mov, mkv)
- allow specifying which extensions and recoded formats to check
3 months ago
86f0c3baaf
[szurubooru] support empty tag searches ( #5711 )
3 months ago
40c685dc43
merge #5712 : [hentainexus] update key
3 months ago
87859ff200
fix: static method defines hostname, update url link
3 months ago
68540aef2a
update nexus key
3 months ago
2e11b6e756
[nijie] support downloading videos ( #5707 , #5617 )
3 months ago
e17b1d5073
[deviantart] fix 2c8aa9b2 ( #5696 )
3 months ago
f160859c5c
[hitomi] extract 'title_jpn' metadata ( #5706 )
3 months ago
Mike Fährmann