34a4ddc399
[sankaku] add 'id-format' option ( #5073 )
8 months ago
a416d4c3d5
[sankaku] support post URLs with alphanumeric IDs ( #5073 )
8 months ago
57fc6fcf83
replace '24*3600' with '86400'
...
and generalize cache maxage values
9 months ago
645b4627ef
[sankaku] update URL patterns
10 months ago
c9a2be36d4
[sankaku] support '/posts/' tag search URLs ( #4740 )
11 months ago
b52fd91ac6
[sankaku] support '/posts/' URLs ( #4688 )
11 months ago
3ecb512722
send Referer headers by default
1 year ago
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
a60db454af
[sankaku] update/fix API headers
...
'Referer' and 'Origin' were both empty
1 year ago
d97b8c2fba
consistent cookie-related names
...
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
1 year ago
3845c0256d
[sankaku] improve warnings for unavailable posts
1 year ago
7f25cab56e
[sankaku] support post URLs with MD5 hashes ( #3952 )
1 year ago
faca32a850
[sankaku] sanitize 'date:…' tags ( #1790 )
1 year ago
107c60c973
[sankaku] update URL pattern ( #3523 )
...
match tag searches with language codes without a trailing slash
2 years ago
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible
2 years ago
775895f44b
[booru] refactor 'tags' and 'notes' extraction
...
- move HTML request for post pages into its own function
- move gelbooru_v02.py notes extraction to gelbooru.py
since it only works there
- clean up some code
2 years ago
5fd4374036
[sankaku] improve 429 and tag limit handling
2 years ago
4089bceddd
[sankaku] implement 'refresh' option ( #2958 )
2 years ago
850608551c
[sankaku] detect expired links ( #2958 )
2 years ago
32c75d12e8
[sankaku] rewrite URLs to s.sankakucomplex.com ( #2746 )
2 years ago
05d4a0215a
[sankaku] extend URL patterns ( fixes #2647 )
...
- support URLs with ISO 639-1 language codes
- support black.… and white.… subdomains
2 years ago
211de95dd0
update extractor test results
3 years ago
9ed13703cc
[sankaku] handle empty tags ( fixes #1617 )
3 years ago
c5ca7905ce
add 'noop()' and 'identity()' functions
3 years ago
6fa20d456b
[sankaku] update invalid-token detection ( fixes #1515 )
3 years ago
bdfcc9c4b1
update extractor test results
3 years ago
0e601de67b
[sankaku] simplify 'pool' tags ( #1388 )
...
normalize 'tags' and 'artist_tags' to a string-list
4 years ago
d085ade9d5
[sankaku] add 'tag_string' metadata field ( #1388 )
...
The 'join()'ed version of 'tags'.
Handling lists in format strings isn't properly supported yet.
4 years ago
2dffd231b7
[sankaku] add enumeration index for books ( #1388 )
4 years ago
96a51ff169
[sankaku] update invalid-token detection ( fixes #1309 )
4 years ago
2da9068ea8
[sankaku] simplify login process
4 years ago
b0beed7a06
[sankaku] add support for book searches ( closes #1204 )
4 years ago
47a7a51944
[sankaku] fix 'invalid_token' detection
4 years ago
e41e2be2f9
[booru] split '_prepare_post()'
4 years ago
b233531aaa
[sankaku] use '/posts' endpoint for single posts
4 years ago
459a0af4f8
[sankaku] add support for sankaku.app URLs ( closes #1193 )
4 years ago
537742c0ee
[sankaku] normalize 'created_at' metadata ( closes #1190 )
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
8d2e4e5f13
[booru] improve error handling
...
e.g. for posts without a valid 'file_url' (#1176 )
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
ecdea799dd
[sankaku] use 'beta.sankakucomplex.com' API endpoints
4 years ago
1e3dd7330e
merge SharedConfigMixin functionality into Extractor
4 years ago
844793847c
update extractor test results
4 years ago
4409d00141
embed error messages in StopExtraction exceptions
5 years ago
7a5e78741c
[booru] build directory path for each file ( #385 )
5 years ago
40637556fa
[ngomik] fix extraction
5 years ago
7a99e85943
[kissmanga] fix download URLs and file extensions
...
The current Blogspot image URLs hosted on Kissmanga end with an
"invalid" query parameter (/000.png&upx=...), which doesn't get
recognized by 'spliturl()' and 'parseurl()' as such and gets therefore
included in the 'extension' field from 'text.nameext_from_url()'.
5 years ago
74c2415138
[sankakucomplex] move article extractor to its own module ( #258 )
5 years ago
1e3e15c4f3
[sankaku] add article extractor ( #258 )
5 years ago
efa805c5d7
[sankaku] update pagination end condition ( fixes #265 )
...
Pagination over popular listings (`date:...+order:popular") never
terminates, not even on the site itself, and at some point returns the
same results over and over again.
5 years ago
Mike Fährmann