d3dca68225
[xvideos] fix galleries with more than 500 images ( #5244 )
7 months ago
13443f40a3
[xvideos] support '/channels/' URLs ( #5244 )
7 months ago
5b979b5706
[xvideos] fix metadata extraction
10 months ago
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
dd884b02ee
replace json.loads with direct calls to JSONDecoder.decode
2 years ago
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible
2 years ago
275543b2d2
update extractor test results
3 years ago
211de95dd0
update extractor test results
3 years ago
bd08ee2859
remove most 'yield Message.Version' statements
...
only leave them in oauth.py as noop results
3 years ago
968d3e8465
remove '&' from URL patterns
...
'/?&#' -> '/?#' and '?&#' -> '?#'
According to https://www.ietf.org/rfc/rfc3986.txt , URLs are
"organized hierarchically" by using "the slash ("/"), question
mark ("?"), and number sign ("#") characters to delimit components"
4 years ago
fad7748b6b
[xvideos] fix 'title' extraction
4 years ago
69e4871005
update extractor test results
...
- sensescans: replace 404d chapters
- mangapark: replace 404d chapters
- subscribestar: update test for attached files
4 years ago
fe19e233f3
[xvideos] improve
...
- derive from GalleryExtractor
- match '…-channels' URLs
- "better" metadata structure
5 years ago
a7b42b37a2
[35photo] fix extraction
5 years ago
fdec59f8e2
replace extractor.request() 'expect' argument
...
with
- 'fatal': allow 4xx status codes
- 'notfound': raise NotFoundError on 404
5 years ago
89ee8cd7e4
filter "private" kwdict entries
6 years ago
61741d7333
provide type information for Queue messages
...
Child extractors are now directly constructed with Extractor.from_url()
if the extractor class is known beforehand, instead of using
extractor.find() and searching through all possible extractor classes.
6 years ago
2e516a1e3e
store the full original URL in Extractor.url
6 years ago
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
6996f5c118
[mangahere] fix and improve chapter extraction
6 years ago
150a6b9064
[xvideos] fix metadata extraction
6 years ago
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
7f899bd5d8
Merge branch 'master' into 1.4-dev
6 years ago
789608c107
[imagebam] fix extraction for certain galleries
6 years ago
cc36f88586
rename safe_int to parse_int; move parse_* to text module
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
2d0cfb33e1
[xvideos] add user profile extractor ( #45 )
7 years ago
a393e6e538
[xvideos] add gallery extractor ( #45 )
7 years ago
Mike Fährmann