3e4ffb0821
[gelbooru] add extractor for '/redirect.php' URLs ( #1530 )
3 years ago
dff03a6605
[booru] add an option to extract notes (only gelbooru for now) ( #1457 )
...
* [booru] add an option to extract notes (currently implemented only for gelbooru)
* appease linter
* [gelbooru] rename "text" to "body" in note extraction
* add a code comment about reusing return value of _extended_tags
3 years ago
918b0441fb
[gelbooru] fix tag category extraction ( #1455 )
3 years ago
780bac4c8a
[gelbooru] update video server ( fixes #1368 )
...
from 'https://img2.gelbooru.com ' to 'https://img3.gelbooru.com '
and provide fallback URLs
4 years ago
08d7934c6e
move extractors from booru.py into their own gelbooru_v02 module
4 years ago
e41e2be2f9
[booru] split '_prepare_post()'
4 years ago
a3a863fc13
[booru] add generalized extractors for *booru sites
...
similar to cc15fbe7
4 years ago
7a0ba370d1
[gelbooru] rewrite mp4 video URLs ( fixes #1048 )
4 years ago
fda9e296dd
[gelbooru] fix extraction without API
4 years ago
9b4635917f
[gelbooru] simplify and fix pool extraction
...
use 'pool:<pool id>' as search tag to get pool posts
4 years ago
2188db6284
[gelbooru] fix non-API tag extraction
5 years ago
7a5e78741c
[booru] build directory path for each file ( #385 )
5 years ago
17a3426845
[gelbooru] enable all content when not using API
5 years ago
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
1d43cbbf52
[gelbooru] tag-splitting for non-api mode
6 years ago
3dbc7c5f8d
[gelbooru] restore pool functionality
6 years ago
a2c74bc6f0
[gelbooru] inherit from BooruExtractor class
...
Breaks pool functionality when using API calls (for now),
but reduces code clutter and enables the `tags` option.
6 years ago
cc36f88586
rename safe_int to parse_int; move parse_* to text module
7 years ago
5008e105ee
update archive IDs
...
... to behave in a more straightforward way when dealing with
bookmarks/favourites/etc.
specific IDs are now grouped by their owner, album-id, ... to
allow for duplicates when it would be expected.
7 years ago
34873dbd90
set 'archive_fmt' values
...
These are going to be used to create an unique id for each image.
7 years ago
d0886f411e
[gelbooru] re-enable API use ( closes #56 )
...
Gelbooru's API allows access to all images and is not restricted
to the first 20000.
This also adds an option to select between API use and manual
information extraction in case their API gets disabled again.
7 years ago
291369eab2
various smaller changes/additions
7 years ago
a1980b16f3
[gelbooru] various improvements
...
- better metadata for pools
- map ratings to s/q/e like other boorus do
- skip() support
7 years ago
214972bc9a
[gelbooru] use manual extraction
...
... to compensate for their disabled API.
(https://gelbooru.com/index.php?page=forum&s=view&id=3875 )
This also adds an extractor for image-pools.
7 years ago
07214f4007
[booru] place subcategories into base classes
7 years ago
4b967fa189
implement and use extractor.config() method
8 years ago
13dc5d72bc
update some extractors to use https
8 years ago
ff92674379
[booru] simple skip functionality
...
(#6 )
8 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
d7e168799d
consistent extractor naming scheme + docstrings
8 years ago
59445c821b
[gelbooru] remove login/auth requirement
8 years ago
616e0aedd6
update booru testdata
9 years ago
5a8541afa5
remove 'unstable' tests
9 years ago
ba99506c72
more extractor test-cases
9 years ago
f7c47a6018
add subcategories to extractors
9 years ago
bb8f2a3e9d
[gelbooru] update to new format
9 years ago
3b0fe8f544
unify booru filename-patterns
9 years ago
c05dbd15b5
[gelbooru] support authentication to enable api access
9 years ago
3c13548f29
rewrite extractors to use config-module
9 years ago
3c6161eea7
small whitespace fixes
10 years ago
5cb46a2cb3
[gelbooru] update to new extractor interface
10 years ago
34d13bc906
added extractor 'danbooru' + split BooruExtractor to handle XML and JSON
10 years ago
2a7dbd8868
[booru] unquote tags to fix multiple tags in urls
10 years ago
deef91eddc
initial commit
10 years ago
Mike Fährmann