Mike Fährmann
c4a201ed42
[tmohentai] simplify + tests
10 months ago
Mike Fährmann
e17a48fe56
[blogger] inherit from BaseExtractor
...
- support www.micmicidol.club (#4759 )
10 months ago
jsouthgb
714b1a7089
[tmohentai] simplify url matching
10 months ago
jsouthgb
31963fa947
[tmohentai] inherit from GalleryExtractor. refactor metadata.
10 months ago
Mike Fährmann
0fa85360a0
merge #4812 : [erome] add 'count' metadata field
10 months ago
Mike Fährmann
a43cf78bb7
[erome] tests
10 months ago
Mike Fährmann
aea15f6d17
add 'metadata-extractor' option ( #4549 )
10 months ago
Mike Fährmann
34a387b6e2
support 'metadata-*' names for '*-metadata' options
...
For example, instead of 'url-metadata' it is now also possible to use
'metadata-url' as option name.
- metadata-url
- metadata-path
- metadata-http
- metadata-version
- metadata-parent
10 months ago
Mike Fährmann
e97d7b1c85
[exhentai] fix empty api_url with '"source": "hitomi"' ( #4829 )
10 months ago
jsouthgb
ed965eecbb
[tmohentai] refactor to str.format for backwards compatibility
10 months ago
jsouthgb
dad7ba1d58
[tmohentai] fix edge cases. updated archive_fmt and filename_fmt
10 months ago
jsouthgb
286d0cb098
[tmohentai] add support
10 months ago
Mike Fährmann
b714df5a16
disable 'downloader.progress' when using -q/--quiet ( #4810 )
...
it didn't produce any output since output.mode is set to to "null",
but it caused some unnecessary function calls
10 months ago
Mike Fährmann
07cb584231
[behance] add 'modules' option ( #4799 )
10 months ago
Mike Fährmann
6a753d9ff3
[behance] support 'text' modules ( #4799 )
10 months ago
Mike Fährmann
ea78f67860
[downloader:http] skip files not passing filesize-min/-max ( #4821 )
...
instead of failing the download
10 months ago
Mike Fährmann
8bf161e574
reorder post processing options shown by --help
10 months ago
Mike Fährmann
168331d147
replace '--ugoira-conv' etc with a general '--ugoira'
...
update --ugoira webm to use the same FFmpeg args as Danbooru
--ugoira-conv -> --ugoira vp8
--ugoira-conv-lossless -> --ugoira vp9-lossless
--ugoira-conv-copy -> --ugoira copy
(--ugoira-conv and co still work as before,
but --help now lists only --ugoira)
10 months ago
Mike Fährmann
97357e65ee
replace '--mtime-from-date' with a more generic '--mtime'
...
--mtime-from-date -> --mtime date
for the same effect as before
(--mtime-from-date also still works,
but --help now lists only --mtime)
10 months ago
Mike Fährmann
387c8b0950
reword some (internal) option text
10 months ago
jsouthgb
c6ad9bcd9b
[erome] add "count" for albums
10 months ago
Mike Fährmann
51e377e612
add '--cbz' command-line option
10 months ago
Mike Fährmann
4700051562
rework and extend input file processing ( #4732 )
...
- add 2 command-line options to modify input file contents
- -I/--input-file-comment
- -x/--input-file-delete
- implement InputManager class
- move code from util.py to __init__.py
(mainly to avoid import cycles)
10 months ago
Mike Fährmann
17e710c4bf
[oauth] warn when cache is enabled but not writeable ( #4771 )
10 months ago
Mike Fährmann
2e4bf54644
[hentaifoundry] check for and update expired sessions ( #4694 )
10 months ago
Mike Fährmann
0435c6e603
[exhentai] handle 'Downloading … requires GP' errors ( #4576 , #4763 )
10 months ago
Mike Fährmann
4288cea94a
[mastodon] fix reblogs ( #4580 )
10 months ago
Mike Fährmann
7a0f145cbe
[twitter] ignore promoted Tweets ( #4790 , #3894 )
...
add 'ads' option in case someone actually wants to
download promoted content for whatever reason
10 months ago
Mike Fährmann
e8b5e59a08
[weibo] detect redirects to login page ( #4773 )
10 months ago
Mike Fährmann
5e58d2b455
[instagram] fix exception on empty 'video_versions' ( #4795 )
10 months ago
Mike Fährmann
807ddde7e1
release version 1.26.2
11 months ago
Mike Fährmann
6402f2950f
[pp:metadata] ignore non-string tag values ( #4764 )
11 months ago
Mike Fährmann
61d6558322
[exhentai] try to avoid 'DH_KEY_TOO_SMALL' errors ( #1021 , #4593 )
11 months ago
Mike Fährmann
69b931b9bb
[exhentai] provide fallback URLs ( #1021 , #4745 )
11 months ago
Mike Fährmann
007c433677
[patreon] support 'id:<campaign_id>' in place of a user name
...
https://patreon.com/id:12345
… and remove 'campaign-id' config option
11 months ago
Mike Fährmann
3984a49abf
[nijie] set 1-2s delay between requests to avoid 429 errors
11 months ago
Mike Fährmann
dd14adccf6
[pixiv] allow cookies for non-OAuth URLs ( #4760 )
11 months ago
Mike Fährmann
caf31e751c
[kemonoparty] limit 'title' length ( #4741 )
11 months ago
Mike Fährmann
43d0c49d7e
[exhentai] fix original image URLs ( #4754 )
11 months ago
Mike Fährmann
43a3d93467
merge #4755 : [twitter] recognize fixupx.com URLs
11 months ago
Mike Fährmann
fc8f86bf24
[hitomi] recognize 'imageset' gallery URLs ( #4756 )
11 months ago
Mike Fährmann
91e20eb59b
[fantia] simplify 'tags' to a list of strings ( #4752 )
11 months ago
Mike Fährmann
72b18d701f
represent util.NONE as 'null' in JSON output
...
was '"None"' before
11 months ago
thatfuckingbird
44d7964c09
[twitter] recognize fixupx.com URLs
11 months ago
Mike Fährmann
56cd9d408d
[weibo] fix Sina Visitor request
11 months ago
Mike Fährmann
68e72a836c
[exhentai] fix extraction ( #4730 )
...
- update to new API response layout
- use proper API server URL
- fix 'filesize' metadata
11 months ago
Mike Fährmann
fd8f58ad76
[behance] unescape embed URLs ( #4742 )
11 months ago
Mike Fährmann
ca1d5c2c0c
merge #4738 : [patreon] parse new bootstrap data format ( #4736 )
11 months ago
Mike Fährmann
4730de163f
[patreon] refactor _extract_bootstrap()
11 months ago
Mike Fährmann
e46efbd5b5
prevent crash when 'stdout.line_buffering' is not defined ( #642 )
11 months ago
Mike Fährmann
c9a2be36d4
[sankaku] support '/posts/' tag search URLs ( #4740 )
11 months ago
Tobias Hellmann
28ada11cba
Try to parse newer HTTP response from Patreon
11 months ago
Mike Fährmann
fd36eafe32
[twitter] restore truncated retweet text ( #3430 , #4690 )
11 months ago
Mike Fährmann
218295a4c6
[twitter] fix avatars without 'date' information ( #4696 )
11 months ago
Mike Fährmann
969be65d0b
[instagram] update API headers
11 months ago
Mike Fährmann
d0effcae20
[kemonoparty] add 'revision_index' metadata field ( #4727 )
11 months ago
Mike Fährmann
3bbaa875f1
[kemonoparty] fix parsing of non-standard 'dates' ( #4676 )
11 months ago
Mike Fährmann
75dec71253
[idolcomplex] disable Referer headers by default ( #4726 )
11 months ago
Mike Fährmann
a09df34bcf
merge #4714 : [4archive] add 'thread' and 'board' extractors
...
(#1262 , #2418 , #4400 , #4710 )
11 months ago
enduser420
acb713b95a
[4archive] update
11 months ago
Mike Fährmann
6766877524
merge #4693 : [reddit] support Reddit Mobile share links
11 months ago
Mike Fährmann
1042278bec
[misskey] support 'misskey.design' ( #4713 )
11 months ago
Mike Fährmann
12a800ce21
[patreon] improve 'campaign_id' handling ( #4699 , #4715 )
...
- add ways to directly specify a 'campaign_id'
- 'campaign-id' config option
- 'c' or 'campaign_id' URL query parameter
- more descriptive error messages
- show 'campaign_id' value in debug log
11 months ago
Mike Fährmann
31dbbffc0b
[twitter] cache 'user_by_…' results ( #4719 )
11 months ago
enduser420
c0714d5585
[4archive] add 'thread' and 'board' extractors
11 months ago
inty
b68aad3dab
[reddit] implement Reddit Mobile share links
11 months ago
Mike Fährmann
95a74be2a5
release version 1.26.1
11 months ago
Mike Fährmann
de224ef3e4
[cookies] include exception in fallback warning
11 months ago
Mike Fährmann
7958ab1946
[newgrounds] support 'imageData' files ( #4642 )
11 months ago
Mike Fährmann
b52fd91ac6
[sankaku] support '/posts/' URLs ( #4688 )
11 months ago
Mike Fährmann
b8674776e9
[4chanarchives] disable Referer headers by default ( #4686 )
11 months ago
Mike Fährmann
78493f0870
[bunkr] fix '/d/' file URLs ( #4685 )
11 months ago
Mike Fährmann
b2c3db3e24
[bunkr] add extractor for media URLs ( #4684 )
11 months ago
Mike Fährmann
0d52b775cb
[kemonoparty] add 'revisions' option ( #4498 , #4597 )
11 months ago
Mike Fährmann
6e830ffc9e
[kemonoparty] support post searches ( #3385 , #4057 )
11 months ago
Mike Fährmann
aaf539009b
[kemonoparty] initial support for post revisions ( #4498 , #4597 )
...
- single revision
https://kemono.party/SERVICE/user/12345/post/12345/revision/12345
- all revisions
https://kemono.party/SERVICE/user/12345/post/12345/revisions
11 months ago
Mike Fährmann
174191cb79
[kemonoparty] restore discord pagination ( #4676 )
11 months ago
Mike Fährmann
c9a976d8a6
[kemonoparty] various updates and fixes ( #4676 , #4681 )
...
- fix pagination
- fix 'date' metadata
- fix discord channel API endpoint
11 months ago
Klion Xu
dc1c2139b1
fix line too long
11 months ago
Klion Xu
6b22af9720
[kemonoparty] update API endpoint ( #4676 )
11 months ago
Mike Fährmann
bfdc07632a
[deviantart] expand nested comment replies ( #4653 )
11 months ago
Mike Fährmann
390d14dbcc
[chevereto] support 'img.kiwi' and 'deltaporno.com' ( #4664 , #1381 )
11 months ago
Mike Fährmann
727c8eec6c
merge #4667 : [redgifs] fix 'niches' extraction ( #4666 )
11 months ago
Mike Fährmann
2911ed1240
[chevereto] add generic extractors ( #4664 )
...
- support jpgfish
- support pixl.li / pixl.is (#3179 , #4357 )
11 months ago
enduser420
db3363ac0b
[redgifs] fix 'niches' extraction
11 months ago
Mike Fährmann
ade8347ead
[kemonoparty] fix DM dates
11 months ago
Mike Fährmann
6dfe200ae4
[kemonoparty] support discord URLs with channel IDs ( #4662 )
11 months ago
Mike Fährmann
c6a3892210
[imgbb] update username extraction ( #4626 )
11 months ago
Mike Fährmann
830a48bca4
[fantia] bad workaround for 833dce14
( #4627 )
...
at least this makes "filter": "content_num == content_count+1"
with "event": "post-after" work
11 months ago
Mike Fährmann
13ce3a9acb
[warosu] fix extraction ( #4634 )
11 months ago
Mike Fährmann
c4c4e4d2f4
[newgrounds] improve 'art-image' extraction ( #4642 )
...
- download files in original resolution
- replace .webp with extension of first file
11 months ago
Mike Fährmann
833dce141f
[fantia] add 'content_count' and 'content_num' metadata fields ( #4627 )
11 months ago
Mike Fährmann
2d41702762
[deviantart] implement '"group": "skip"' ( #4630 )
11 months ago
Mike Fährmann
992e86ec94
[deviantart] disable 'jwt' ( #4652 )
11 months ago
Mike Fährmann
2974b8e3c8
[moebooru] add 'metadata' option ( #4646 )
...
for extended 'pool' metadata
11 months ago
Mike Fährmann
d194ea68a9
[cookies] open cookie databases in read-only mode
...
bypasses the need to copy the entire database file
might solve #4195
11 months ago
Mike Fährmann
8bb7243c10
[reddit] fix wrong previews ( #4649 )
...
caused by a failed comment URL
using the main submission's preview as fallback
14af15bd
4963bb9b
12 months ago
Mike Fährmann
08bdde5aac
merge #4619 : [twitter] add 'sensitive' metadata field
12 months ago
Mike Fährmann
f3d6aaff13
[twitter] rename to 'sensitive'; use 'tget()'
12 months ago
Mike Fährmann
95c280c59b
[imgbb] update pagination end condition ( #4626 )
12 months ago
Mike Fährmann
2e350dd82a
merge #4626 : [imgbb] fix 'user' extraction, add 'displayname'
12 months ago
Mike Fährmann
a2daa9befe
[imgbb] fix flake8 and username order
12 months ago
Mike Fährmann
67ba4ee842
[pp:exec] support more replacement fields for '--exec' ( #4633 )
...
- {_directory}
- {_filename}
- {_path} (alias for {})
12 months ago
Mike Fährmann
9a008523ac
[hentaifoundry] fix '.swf' file downloads ( #4641 )
12 months ago
Mike Fährmann
15f940819b
[newgrounds] support 'art-image' files ( #4642 )
12 months ago
Mike Fährmann
63db54b905
[patreon] update 'campaign_id' path ( #4639 )
12 months ago
HRXN
b846f56c3a
[imgbb] Fix `user` extraction, add `displayname`
12 months ago
Mike Fährmann
efaab4fbfa
[twitter] fix crash due to missing 'source' ( #4620 )
...
regression caused by 06aaedde
12 months ago
Nahida
3438a3098d
[twitter] add possible_sensitive field
12 months ago
Mike Fährmann
85357c1ef8
release version 1.26.0
12 months ago
Mike Fährmann
64dbc58a5a
[deviantart] update Eclipse API endpoints 2 ( #4615 )
12 months ago
Mike Fährmann
84fbbd96aa
[shimmie2] remove 'meme.museum'
12 months ago
Mike Fährmann
aa77fda78c
[instagram] better error message for invalid users ( #4606 )
12 months ago
Mike Fährmann
482f002e1f
[nsfwalbum] detect '/error.jpg' images ( #4598 )
12 months ago
Mike Fährmann
eb230e4b77
[nsfwalbum] disable Referer headers by default ( #4598 )
12 months ago
Mike Fährmann
b92645cd37
[bunkr] fix extraction ( #4514 , #4532 , #4529 , #4540 )
12 months ago
Mike Fährmann
4477808d1c
fix symlink resolution in __main__.py
...
adapt ytdl order
12 months ago
Mike Fährmann
be17103e21
[regifs] support 'order' parameter for user URLs ( #4583 )
12 months ago
Mike Fährmann
7150c4c76c
fix imports when using the gallery_dl directory as argument ( #4581 )
12 months ago
HRXN
ec91eeb7ef
Update gallery_dl/extractor/reddit.py
...
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
12 months ago
HRXN
66613c3a32
[reddit] ignore '/message/compose' URLs without www subdomain
1 year ago
Mike Fährmann
bb39779e1a
[deviantart] use private tokens for 'is_mature' posts ( #4563 )
1 year ago
Mike Fährmann
0c5d8b1505
[deviantart] re-add 'quality' option and 'intermediary' transform
1 year ago
Mike Fährmann
20d1683c47
[deviantart] fix JWT replacement ( #293 , #4548 , #4563 )
...
And again, a huge thank you to @Ironchest337
for discovering this.
1 year ago
Mike Fährmann
d7aac9fc06
[reddit] ignore '/message/compose' URLs ( #4482 )
1 year ago
Mike Fährmann
1e31fce37b
[pillowfort] support '/tagged/' URLs ( #4570 )
1 year ago
Mike Fährmann
1d2fd0b831
[pillowfort] extract 'b2_lg_url' media ( #4570 )
1 year ago
Mike Fährmann
50e2ebaff0
[danbooru] support 'donmai.moe' URLs
1 year ago
Mike Fährmann
82296b1f05
[reddit] add 'previews' option ( #4322 )
...
another way to disable this new behavior
1 year ago
Mike Fährmann
918ba4f847
[redgifs] match gfycat image URLs ( #4558 )
1 year ago
Mike Fährmann
2ad75bab05
[deviantart] add 'is_original' metadata field ( #4559 )
...
true for 'downloadable' content, journals, flash animations,
and images without '/v1/' in their URL; false otherwise
1 year ago
Mike Fährmann
9d8317d963
[deviantart] disable JWT updates ( #4548 , #4563 )
...
back to lowres images ...
1 year ago
Mike Fährmann
8064663bda
[deviantart] update Eclipse API endpoints ( #4553 )
1 year ago
Mike Fährmann
2cd801232b
fix --range causing crashes ( #4557 )
...
regression caused by a383eca7
1 year ago
Mike Fährmann
3528974459
[instagram] handle exceptions due to missing media ( #4555 )
1 year ago
Mike Fährmann
4963bb9b30
[reddit] improve comment metadata v2 ( #4482 )
...
provide main submission metadata at the top level
and comment metadata inside the 'comment' field,
i.e. the other way round than in 1710f1e9
1 year ago
Mike Fährmann
7592c5e566
[patreon] fix extraction ( #4547 )
1 year ago
Mike Fährmann
0655ce1bae
[mangakakalot] update domain
...
the old one still works, but it incurs a redirect
1 year ago
Mike Fährmann
3ecb512722
send Referer headers by default
1 year ago
Mike Fährmann
cb4798f07a
[architizer] fix extraction ( #4537 )
1 year ago
Mike Fährmann
6178177227
[twitter] fix '_extractor' of following results ( #4536 )
...
regression from 20ed647f
1 year ago
Mike Fährmann
d13c82eff1
[kemonoparty] update favorites API endpoint ( #4522 )
1 year ago
Mike Fährmann
27ec653991
fix bug in test_init and update example URLs
1 year ago
Mike Fährmann
24a1d46391
[mastodon] support '/@USER/following' URLs
...
Previously, only '/users/USER/following' got matched.
1 year ago
Mike Fährmann
9f75713e00
[recursive] simplify
1 year ago
Mike Fährmann
899df8f237
remove another '*' for keyword-only arguments
...
076380e0
1 year ago
Mike Fährmann
6ae92da57e
Merge branch 'tests'
1 year ago
Mike Fährmann
32da3c70d3
[behance] handle videos without 'renditions' ( #4523 )
1 year ago
Mike Fährmann
ae5e049c4f
[redgifs] provide 'collection' metadata in a separate field ( #4508 )
...
instead of overwriting the actual metadata
1 year ago
Mike Fährmann
1710f1e983
[reddit] improve comment metadata ( #4482 )
...
- provide 'date'
- make metadata of the main submission available as 'submission[…]'
1 year ago