025f6e3398
add fallback for missing WITHOUT ROWID support ( #553 )
5 years ago
87c8b89ddd
[postprocessor:metadata] add 'directory' option ( #520 )
5 years ago
1afb91363c
[imagefap] generalize URL patterns and add tests ( #552 )
5 years ago
f701e9f33a
Handle beta.imagefap.com URLs ( #552 )
5 years ago
ce54b8c04c
let extractors opt-out of cookie option usage
...
useful to avoid sending unnecessary cookies when all authentication
is done through OAuth tokens
5 years ago
5ad92fc196
[newgrounds] fix tags metadata extraction
5 years ago
82f7f4172a
update test results
5 years ago
1f2a69f3c5
add '_extractor' information to redirect results
5 years ago
2d4887b75b
improve KeywordJob output for "parent" extractors ( closes #548 )
5 years ago
a27f43dad1
[pixiv] wait and retry after rate limit error ( closes #535 )
5 years ago
6b373cb7e2
[exhentai] restrict default directory name length ( #545 )
5 years ago
b347bf68c7
[deviantart] add extractor for followed users ( #515 )
5 years ago
c0f391a4e2
[pixiv] support listing followed users ( #515 )
5 years ago
2e2fc7f0ad
prevent infinite recursion when spawning extractors ( closes #489 )
5 years ago
896896a490
[twitter] fix URLs forwarded to youtube-dl ( closes #540 )
...
Since commit 3bba763
5 years ago
1e2713b895
[artstation] fix search result pagination ( closes #537 )
5 years ago
bf3df3d0b0
[directlink] send Referer headers ( closes #536 )
5 years ago
83909ab5d4
release version 1.12.1
5 years ago
9be7ff600e
[imagetwist] replace test image
...
the old one expired, it seems
5 years ago
66905b1664
[foolslide] add fallback for chapter data extraction
5 years ago
dd92b25c17
quote URLs and arguments in examples ( #513 )
5 years ago
48e42e73fb
[reddit] change default value for 'comments' to '0'
5 years ago
9c0928457a
[reddit] fix errors with 't1_…' submissions
5 years ago
58391d492d
cache archive keys generated in __contains__() ( #524 )
...
To avoid writing a different key to the archive than what was checked
against before the file download.
5 years ago
bf658fd84b
[vsco] implement 'videos' option
5 years ago
95c90722ee
[instagram] implement 'videos' option ( closes #521 )
5 years ago
1921c127a5
make OSErrors during file downloads nonfatal ( closes #512 )
...
… except ENOSPC (No space left on device), since there is no reason to
continue downloading in that case.
All other errors that would prevent downloading data and writing it to
disk get already raised during directory creation and are therefore not
checked here.
5 years ago
d0920e84e9
update test results
5 years ago
8c11e81c9f
Merge commit '63e6993716db8d8bedfb7b0d445c7161493046b6'
5 years ago
63e6993716
merge 'bypost' functionality into metadata postprocessor
5 years ago
31a29835ff
[realbooru] simplify extractors and update tests ( #514 )
5 years ago
9a4ce20b8e
[realbooru] Add Realbooru extractor ( #514 )
5 years ago
f9e74320de
retain trailing zeroes in Cloudflare challenge answers
5 years ago
72b8fbfbad
[instagram] make post-page extraction nonfatal
5 years ago
922b8a9595
[weibo] raise NotFoundError for unavailable/deleted statuses
5 years ago
0cd157300e
[patreon] fix regex pattern for posts
...
The previous one would match the first number in the URL slug as
post ID, which would fail for posts with numbers in their title.
5 years ago
fe19e233f3
[xvideos] improve
...
- derive from GalleryExtractor
- match '…-channels' URLs
- "better" metadata structure
5 years ago
d3e44e899d
raise NotFoundErrors for 404 responses in GalleryExtractors
5 years ago
a4dd8b3dab
improve _check_cookies()
...
Only loop over all cookies once instead of calling
cookiejar._find() for each cookie name.
5 years ago
76e60d10a6
[patreon] raise proper exception if creator/post doesn't exist
5 years ago
9e63804347
[patreon] make retrieving user info nonfatal ( #508 )
...
… and fall back to the included data if an error occurs.
5 years ago
964dc57286
[vsco] improve image resolutions
...
https://im.vsco.co/ URLs redirect to the appropriate CDN server
and occasionally insert a '/1200x1600/' into the image path,
limiting image dimensions.
This commit constructs redirect targets out of the given
im,vsco.co URLs without sending extra HTTP requests
and without any "builtin" resolution restrictions.
5 years ago
0629fe8fa4
[vsco] fix user profile extraction … again
...
Given the pattern from last time, collections will also change
in due time and use cursor-based pagination.
5 years ago
ab17ea9632
[deviantart] only print warning if 'original' is enabled
5 years ago
2188db6284
[gelbooru] fix non-API tag extraction
5 years ago
c4702ec9b6
simplify some logging calls
5 years ago
c0b9ad678d
Separate metadata from handle_url into handle_metadata, commenting
5 years ago
c9ef1b21c3
[patreon] get partial user info without /api/user/<id> ( #507 )
...
It's a lot less data, but doesn't invoke any additional
HTTP requests with potential Cloudflare CAPTCHAs.
5 years ago
0ab9bb1721
[4chan] add extractor for entire boards ( closes #510 )
5 years ago
c59b98c81b
[downloader:http] improve rate limit handling
...
- Move the download "logic" with rate limit checks into its own
method that only gets used if a rate limit should be enforced
- Fix an issue where suspending gallery-dl during a download would
basically ignore the rate limit for the remaining download when
resuming its execution.
5 years ago
Mike Fährmann