caae8fefe1
merge #3541 : [deviantart] add extractor for status updates
2 years ago
d63af4f3d3
merge #3555 : [generic] fix regex for non-src image URLs
2 years ago
8993b10751
[mastodon] add 'num' and 'count' metadata fields ( #3517 )
2 years ago
d817d23ccb
[instagram] update csrf token handling
...
- update internal value according to cookie
- do not send a second 'csrftoken' cookie
2 years ago
00b94946b3
[instagram] show -o cursor=… after every error ( #3440 )
2 years ago
8cfeed78b1
[generic] fix regex for non-src image URLs
2 years ago
fc6ea8ee5c
[instagram] update API domain and headers
2 years ago
597b89245e
[deviantart] misc improvements to status extractor
...
- relax regex pattern
- handle invalid 'items' field
- add a test for shared sta.sh item
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2 years ago
137de090dd
merge #3549 : [twitter] fix search ( #3536 )
2 years ago
02e314c1b6
merge #3537 : [wikifeet/wikifeetx] add 'gallery' extractor
2 years ago
568112dfbb
[oauth] improve output
...
- show which api key / client id gets used (#3518 )
- show in which browser authorization URLs gets opened in
2 years ago
ab58c375b4
[twitter] fix search ( #3536 )
...
- partially revert 18fe4b334d
2 years ago
df91ebb945
[oauth] simplify OAuth 1.0a init
2 years ago
013733c9e9
[deviantart] fix index fields for embedded/shared images
2 years ago
c4aeca7a5a
[deviantart] improve handling of statuses
...
- recursively yield statuses
- ignore items with missing or unexpected field(s)
2 years ago
3b32671fbd
[deviantart] add extractor for status updates
...
extract user status updates using the '/user/statuses/' endpoint
2 years ago
107c60c973
[sankaku] update URL pattern ( #3523 )
...
match tag searches with language codes without a trailing slash
2 years ago
5cb263fdd2
[wikifeet/wikifeetx] add 'gallery' extractor
2 years ago
35a30498bc
merge #3531 : [kemonoparty] improve hash extraction
...
- extract md5 hashes if available
- extract discord file hashes
2 years ago
ec9ff7640d
merge #3535 : [downloader:http] add signature checks for .blend, .obj, and .clip files
2 years ago
9683d79bb7
[twitter] "fix" search pagination ( #3536 , #3534 )
...
- properly process instructions
- do not expect a predetermined instruction order
2 years ago
4e86aaa4db
document 'extractor.headers' and 'extractor.ciphers'
2 years ago
4fec848858
[twitter] use "browser": "firefox" by default ( #3522 )
...
and reenable TLS 1.2 ciphers
2 years ago
78937564fd
[twitter] fix login after 32b03433
2 years ago
b6706b373a
[downloader:http] add signature checks for some formats
...
also add the MIME type for .obj files
2 years ago
20d6194ffa
[kemonoparty] improve hash extraction
...
- extract MD5 hash from URLs
- extract MD5 and SHA256 hash from Discord URLs (kemono.party only)
- minor optimization (do not call 'hashes.add' when 'duplicates' is
true)
- update tests accordingly
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2 years ago
80a2ff2d38
support setting 'write-pages' to "ALL"
...
to show authentication header, cookies, etc
2 years ago
d6793b2c7d
include request body in 'write-pages=all' output
2 years ago
c881548a27
add 'extractor.retry-codes' option ( #3313 )
...
do not retry 429 and 430 by default
2 years ago
e30e8aeef7
[mastodon] rename '_check_move' -> '_check_moved'
2 years ago
32b0343334
[twitter] refresh guest tokens ( #3445 , #3458 )
2 years ago
512abeb4ae
[booru] add 'url' option
2 years ago
c87bd1a752
[danbooru] extend 'metadata' option
...
make it possible to specify a custom list of metadata includes
2 years ago
26c3292538
[twitter] disable TLS 1.2 ciphers by default ( #3522 )
2 years ago
18fe4b334d
[twitter] remove 'tweet_search_mode' from search parameters ( #3522 )
...
and update API root and general query parameters
2 years ago
ec04c97075
release version 1.24.4
2 years ago
c0d7d2be35
[downloader:http] add 'validate' option
2 years ago
85bd1cbc89
[kemonoparty] fix regression from 473bd380 ( #3519 )
...
- do not access 'response.content' unless necessary
- only validate responses if filename extensions differ
2 years ago
805a5663ec
release version 1.24.3
2 years ago
473bd380c8
[kemonoparty] reject invalid/empty files ( #3510 )
2 years ago
4833ec323e
[imagefap] add 'folder' extractor ( #3504 )
2 years ago
cb9d100bac
update Authentication support in docs
...
https://github.com/mikf/gallery-dl/pull/3075#issuecomment-1374723412
2 years ago
71d3143c35
fix bug in test_extractors.py
...
pattern matching tests would succeed
if there is exactly one match
but for the wrong extractor
2 years ago
362cd6991b
[pixiv] implement 'metadata-bookmark' option ( #3417 )
2 years ago
0895e6afee
merge #3462 : [docs] Update links and fix field typo
2 years ago
4b9bb632f2
[docs] update links
2 years ago
2142b9c7ae
merge #3503 : [myhentaigallery] handle whitespace before title tag
2 years ago
3a0450adbf
[behance] use default delay between requests ( #2507 )
2 years ago
2cae4567ba
[telegraph] fix file URLs ( #3506 )
2 years ago
cbaeee9533
[imagefap] warn about redirects to '/human-verification' ( #1140 )
2 years ago
Mike Fährmann