ed317bfcf1
warn about cookies expiring in less than 24 hours
...
requires an expiration timestamp,
so this only works with cookies from a cookies.txt file
3 years ago
b17e2dcf93
[wallpapercave] add extractor for images ( #2205 )
3 years ago
c661737f36
[Imgbox] Fix ImgboxExtractor ( #2281 )
3 years ago
cf3b51f8aa
fix building supportedsites.md on Python 3.4 and 3.5
...
dicts didn't maintain insertion order back then
3 years ago
a7de819aca
[lightroom] add Lightroom gallery extractor ( #2263 )
3 years ago
563bd0ecf4
[danbooru] inherit from BaseExtractor
...
- merge danbooru and e621 code
- support booru.allthefallen.moe (closes #2283 )
- remove support for old e621 tag search URLs
3 years ago
bc0e853d30
combine KeyError & IndexError to common base class LookupError
3 years ago
f1c853c6ef
[furaffinity] add 'layout' option ( #2277 )
...
to be able to force gallery-dl to parse according to a specific layout
in case its auto-detect fails
3 years ago
4e4cb40663
do not sort BaseExtractor instances by name
3 years ago
b4f8e15a1f
allow BaseExtractors to use the domain pf the matched URL
3 years ago
c0fddcefc5
[downloader:ytdl] make ImportErrors non-fatal ( #2273 )
3 years ago
a57a44f510
[kemonoparty] handle files without 'name' ( fixes #2276 )
3 years ago
4efe56f419
[furaffinity] improve new/old layout detection ( fixes #2277 )
3 years ago
0f1e7ff319
[twitter] fix extraction ( #2275 )
3 years ago
f351746483
release version 1.20.4
3 years ago
dee0d22561
update extractor test results
3 years ago
d7b8e04b50
[kemonoparty] use 'Accept-Encoding: identity' for all downloads
...
(#2267 )
fixes issues when data send with 'Content-Encoding: gzip' or other
encodings is larger than the actual file
3 years ago
f4a7c6eca2
Add two examples for custom instances of gelbooru ( #2262 )
...
* Add two examples for custom instances of gelbooru
- First example uses some custom options at the "gelbooru_v01" basecategory
These apply to all instances used herein
- Second example adds all options to the specific "gelbooru_v02" basecategory of TBIB
These settings are only used by TBIB
* move tbib settings into their own block
3 years ago
55326377d8
Add Kohlchan extractor ( #2251 )
3 years ago
cc7dce5755
[sexcom] add 'pins' extractor ( closes #2265 )
3 years ago
02e18f56be
[e621] add 'favorite' extractor ( closes #2250 )
3 years ago
70e6e1549e
[twitter] provide fallback URLs for card images
...
f2e8aedd74 (commitcomment-64057751)
3 years ago
86fa412b47
[hitomi] add 'format' option ( #2260 )
...
default is 'webp' since downloading original files is no longer allowed
3 years ago
492436f936
[twitter] add 'warnings' option ( #2258 )
...
disable reporting any non-fatal errors by default
3 years ago
a5163e4c70
[twitter] restore 'logout' functionality ( #1719 )
3 years ago
f58364f6a8
update Firefox cipher list
3 years ago
7e6981dda6
rename 'disabletls12' to 'tls12'
...
and let config options override any default settings
3 years ago
bb3e182562
overhaul session initialization
...
- share adapter & connection pool across sessions with the same
ssl options, ssl ciphers, and source address
- simplify browser emulation to just a list of headers and ciphers
3 years ago
e670dc518e
[weibo] update pagination code ( fixes #2244 )
...
- send proper headers and query parameters
- use 'since_id' instead of page numbers
- set a 1-2 second delay between requests
3 years ago
4c651f6252
[patreon] Disable TLS 1.2 by default ( #2249 )
...
Disables TLS 1.2 on Patreon by default.
3 years ago
392cf079f7
Add ability to disable TLS 1.2 ( #2243 )
...
Fix for Patreon Cloudflare issues by having only TLS v1.3 or higher establish HTTPS connections
This now allows you to disable it on a per-host or global basis. Add disabletls12 as a config option either under extractor.(host) or just under extractor. Option is false by default.
Example:
"patreon":
{
"disabletls12": true,
"cookies": {
"session_id": "X"
}
}
3 years ago
d33227fc38
[twitter] restore errors for protected timelines etc ( fixes #2237 )
3 years ago
ebd3d5c1cc
[bunkr] fix .mp4 downloads ( closes #2239 )
3 years ago
e2be199124
[gelbooru] improve and fix pagination ( #2230 , #2232 )
...
Use 'id:<POSTID' as a tag instead of going through pages with 'pid'.
Something similar was already implemented in 93cef7843085aac4
3 years ago
806badbeec
release version 1.20.3
3 years ago
8230f31800
[twitter] update query hashes
3 years ago
c180806cec
[twitter] fix deleted/invalid retweets ( #2225 )
3 years ago
a2eecc6aa8
[kemonoparty] fix DMs extraction ( #2008 )
3 years ago
2bf554a896
[twitter] fix several errors ( #2212 , #2216 , #2225 )
...
- fix Tweets with deleted quotes
- fix suspended Tweets without 'legacy' entry
- fix unified_cards without 'type'
3 years ago
fbd17547f5
release version 1.20.2
3 years ago
e5242b83bf
[twitter] define directory format for events ( #2109 )
3 years ago
efb3e65a6a
[sexcom] extend URL pattern ( fixes #2220 )
3 years ago
3f2b6335d7
[instagram] fix highlights extraction ( #2197 )
...
* [instagram] fix highlights extraction
* [instagram] improve highlights extraction
- 'yield' individual reels instead of collecting them in a list
and returning them all at once
- reduce 'chunk_size' to an even saver value
(instagram.com also uses 5)
3 years ago
5ed26e1773
[twitter] fix pinned tweets ( #2216 )
...
caused by the changes in dffa440ede
3 years ago
a9f78e6527
[twitter] improve error handling
...
- handle accounts without 'rest_id'
- handle timelines with empty 'instructions'
3 years ago
729b07c1f5
[twitter] simplify
...
- use dict with common GraphQL variables
- reduce 'variables' size with custom JSON encoder instance
- centralise TwitterAPI() creation
3 years ago
7cb29224f0
[philomena] fix search parameter escaping ( #2215 )
...
The pluses from search terms in /tags/ URLs need to be
replaced with spaces to get accepted by Philomena.
3 years ago
9ca8bb2dc0
[twitter] improve error handling
3 years ago
9a221494c3
[twitter] add 'event' extractor ( closes #2109 )
3 years ago
14867dad6b
[twitter] fix unified cards from search results
3 years ago
Mike Fährmann