807e2f7094
[realbooru] fix videos and provide fallback URLs ( #2530 )
...
revert acc94ac187
4 months ago
acc94ac187
[realbooru] fix extraction
...
revert ac97aca99c
8 months ago
93b4120e77
[gelbooru] support 'all' and empty tag ( #5076 )
8 months ago
89066844f4
add 'config_instance' method
...
to allow for a more streamlined access to BaseExtractor instance options
8 months ago
085411f3f1
[rule34] recognize URLs with 'www' subdomain ( #4984 )
9 months ago
a453335a9f
remove test results in extractor modules
...
and add generic example URLs
1 year ago
6eca1fab9b
[gelbooru_v02] support 'xbooru.com' ( #4493 )
1 year ago
a383eca7f6
decouple extractor initialization
...
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().
This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
1 year ago
ac97aca99c
[realbooru] fix extraction
...
get file URLs from HTML pages
1 year ago
cd931e1139
update extractor test results
2 years ago
6423f990de
[realbooru] fix 'tags' extraction ( #2530 )
2 years ago
ecad02cf3f
[realbooru] fix download URLs ( #2530 )
2 years ago
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible
2 years ago
4fd3c893fa
[booru] adjust/match '_tags' and '_notes' code
2 years ago
88954aa2e4
[gelbooru_v02] implement 'notes' extraction
...
same code as for 'moebooru' works here as well
2 years ago
775895f44b
[booru] refactor 'tags' and 'notes' extraction
...
- move HTML request for post pages into its own function
- move gelbooru_v02.py notes extraction to gelbooru.py
since it only works there
- clean up some code
2 years ago
67a2efb885
[rule34] implement 'pool' pagination ( #2853 )
2 years ago
f225247670
[gelbooru] add support for `api_key` and `user_id` ( #2767 )
2 years ago
c6a9bab019
update extractor test results
2 years ago
ff5e10a86d
[hypnohub] move to gelbooru_v02 instances ( #2631 )
2 years ago
d26da3b9e5
add pre-generated 'pattern' for supported BaseExtractor sites
2 years ago
3e926bd465
[realbooru] fix extraction ( fixes #2530 )
2 years ago
dee0d22561
update extractor test results
3 years ago
199e7616a7
[rule34] use https://api.rule34.xxx for API requests
3 years ago
93cef78450
[gelbooru] workaround pagination limits
...
Gelbooru only allows to retrieve the latest 20k posts for a tag search.
Add 'id:<N' to the search tags to work around that limitation, where N
is the ID of the last retrieved post.
http://gelbooru.me/index.php?page=forum&s=view&id=1467
3 years ago
7bbb1f92d7
[gelbooru_v02] add 'favorite' extractor ( closes #1834 )
3 years ago
dff03a6605
[booru] add an option to extract notes (only gelbooru for now) ( #1457 )
...
* [booru] add an option to extract notes (currently implemented only for gelbooru)
* appease linter
* [gelbooru] rename "text" to "body" in note extraction
* add a code comment about reusing return value of _extended_tags
3 years ago
918b0441fb
[gelbooru] fix tag category extraction ( #1455 )
3 years ago
3df527ee2c
update extractor test results
4 years ago
59fd740b47
[tbib] add support for https://tbib.org/ ( #473 , closes #1082 )
4 years ago
08d7934c6e
move extractors from booru.py into their own gelbooru_v02 module
4 years ago
Mike Fährmann