7f1ed909d5
[imgur] match gallery/album/image URLs with title slugs ( #5593 )
4 months ago
5842e4928d
[imgur] fail downloads when redirected to 'removed.png' ( #5308 )
6 months ago
3ecb512722
send Referer headers by default
1 year ago
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
1d2b5d0c60
update test comment positions
...
always put them above the test they're referring to
1 year ago
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
d12dd3813c
[imgur] fix internal image/album URLs
...
URLs from "link" attributes of newer images/albums were all returned
as 'https://imgur.com/gallery/ ...' instead of the expected format,
causing them to be ignored.
1 year ago
8520de57f0
[imgur] add 'favorite-folder' extractor ( #4016 )
1 year ago
aaf58a1259
[imgur] document 'client-id' option ( #3937 )
1 year ago
bf1649dadb
[imgur] add support for imgur.io URLs
2 years ago
4598d32370
[imgur] prevent exception for empty albums ( closes #2557 )
2 years ago
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
3 years ago
4fc9668922
[imgur] update URL patterns ( #1561 )
3 years ago
0b55f5ad84
[imgur] fix/improve rate limit handling ( #1386 )
...
- also wait-and-retry on 429 status codes
- use infinite loop instead of recursive calls
- 'extractor.sleep()' -> 'extractor.wait()'
4 years ago
3df527ee2c
update extractor test results
4 years ago
968d3e8465
remove '&' from URL patterns
...
'/?&#' -> '/?#' and '?&#' -> '?#'
According to https://www.ietf.org/rfc/rfc3986.txt , URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
4 years ago
799ca07fc8
[imgur] update
...
- fix image/album detection for galleries
- use new API endpoints for image/album data
4 years ago
ab1af66a97
[imgur] add 'search' extractor ( #934 )
4 years ago
e4bbc1fb5c
[imgur] add 'tag' extractor ( #934 )
4 years ago
ec5870576d
[imgur] handle 403 overcapacity responses ( closes #910 )
4 years ago
27d163afb3
[imgur] support all '/t/...' URLs ( closes #880 )
...
… instead of just '/t/unmuted/'
4 years ago
bd0e1ca1a5
[imgur] build directory path for each file ( closes #842 )
4 years ago
6bcdb264e0
[imgur] treat 't/unmuted' URLs as galleries
4 years ago
b6cee3e45b
[imgur] fix extraction of animated images without 'mp4' entry
4 years ago
4e361b3008
add tests for specific datetime values
5 years ago
32d7195d08
[pinterest] improve detection of invalid pin.it links
5 years ago
1f2a69f3c5
add '_extractor' information to redirect results
5 years ago
6e23c0da09
[imgur] add extractor for subreddit links ( closes #500 )
5 years ago
e9aed62c91
[imgur] unescape image titles
5 years ago
b0197098e6
[imgur] get title from webpage if missing in API response
...
(closes #467 )
5 years ago
8f38a35b91
[imgur] use API with "public" client_id ( #446 )
...
Using the API endpoints makes it possible to access NSFW content
without logging in.
5 years ago
7ebd984e8d
[imgur] print error message if no JSON data is found ( #446 )
5 years ago
5882b00f2f
[imgur] implement login support ( #446 )
5 years ago
913460240d
[reddit] fix 'extractor.blacklist()' arguments
...
The second argument must support 'append()'.
5 years ago
4330133114
[imgur] add 'favorite' extractor ( closes #420 )
...
… and use a newer site-internal API endpoint for user posts
5 years ago
d780f0357e
[imgur] add user extractor
5 years ago
7d6af936c5
[imgur] simplify gallery extraction
5 years ago
829b1ccf04
[imgur] distinguish album and gallery URLs ( #380 )
...
A gallery can be either an album or a single image.
5 years ago
fdec59f8e2
replace extractor.request() 'expect' argument
...
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
5 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
34bab080ae
rewrite URL patterns to use only 1 per extractor
6 years ago
ff436692bf
["deviantart] add 'journals' option
6 years ago
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
ad14de19c6
[imgur] support "unmuted" URLs
6 years ago
4cea886177
[imgur] allow longer album hashes
6 years ago
1b80fa82a9
[imgur] update URL pattern and tests
7 years ago
179bcdd349
adjust archive-ids
7 years ago
3cec533c28
Merge branch 'archive'
7 years ago
20af86b2ea
add more extractor tests
...
for mangastream, reddit and imgur
7 years ago
Mike Fährmann