3dbc7c5f8d
[gelbooru] restore pool functionality
6 years ago
a2c74bc6f0
[gelbooru] inherit from BooruExtractor class
...
Breaks pool functionality when using API calls (for now),
but reduces code clutter and enables the `tags` option.
6 years ago
4a57509392
generalize tag-splitting option ( #92 )
...
- extend functionality to other booru sites:
- http://behoimi.org/
- https://konachan.com/
- https://e621.net/
- https://rule34.xxx/
- https://safebooru.org/
- https://yande.re/
6 years ago
188e956c4e
[imagefap] use HTTPS + update test results
6 years ago
87853538b4
[yandere] add option to split tags by type ( #92 )
6 years ago
a699787d01
[deviantart] update URL patterns to new format
...
DeviantArt changed its URL format from
https://<name>.deviantart.com/...
to
https://www.deviantart.com/ <name>/...
With this change both formats will be supported.
6 years ago
0055fdd714
change OAuth test server
...
DNS record for oauthbin.com expired
6 years ago
9e3415886c
[senmanga] fix/update tests
6 years ago
973cf98e88
fix download skip for files without extension
6 years ago
b8c97d2295
use 'extractor.request()' for more HTTP requests
6 years ago
cc15c6105c
release version 1.4.1
6 years ago
150a6b9064
[xvideos] fix metadata extraction
6 years ago
7a98cc9798
[smugmug] update tests
...
My test account expired and all uploaded images got deleted.
6 years ago
4eb94aca17
[postprocessor:ugoira] pass '-f' if not present
6 years ago
0c1c4557dd
[postprocessor:ugoira] add option for two-pass encoding
6 years ago
a9e276bc37
reset delete-flag
...
Since 'PathFormat' objects are being reused, setting `delete`
to True once caused all files downloaded after to be deleted as well.
6 years ago
91340d9d27
[pixiv] fix ugoira test
6 years ago
709c5d466d
add '--zip' and '--ugoira-conv' command-line options
6 years ago
eb7a1f3b98
[pixiv] rework ugoira handling
...
Frame information now gets attached to the ZIP file's keyword dict
instead of being written to a separate text file.
6 years ago
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
b84e71da91
add postprocessor documentation to configuration.rst
6 years ago
613b692275
[postprocessor:ugoira] add a few options
...
- ffmpeg-location: path to the ffmpeg (or avconv) executable
- ffmpeg-args: additional command line args for ffmpeg
- extension: filename extension of the resulting video file
6 years ago
a444755979
[postprocessor] add 'ugoira' to convert pixiv animations to webm
6 years ago
f10bd5cdbe
[4chan] unescape filenames
6 years ago
eec081dd3e
[postprocessor:zip] delete directory ( #85 )
6 years ago
2d1a104739
[mangadex] unescape manga names and chapter titles
...
pretty sure I previously tested if unescaping strings from the
embedded JSON object was necessary ... maybe they changed it
6 years ago
3bcce77f6d
release version 1.4.0
6 years ago
6ac403c5d3
add postprocessor config example
6 years ago
2403c405e3
Merge branch 'postprocessor'
6 years ago
baccf8a958
improve postprocessor handling
...
- add pathfmt argument for __init__()
- add finalization step
- add option to keep or delete zipped files
6 years ago
2628911ba0
[pp:exec] add 'async' option
6 years ago
7646bdbcfd
improve postprocessor initialization code
6 years ago
b344f2290f
fix downloader tests
6 years ago
37d97ff02c
[pp:classify] use temppath
6 years ago
97189e50cd
[pp:zip] use temppath; add options
6 years ago
821535b458
adjust PathFormat class
6 years ago
a47c6136cd
[simplyhentai] avoid redirects for all-pages.json ( #89 )
6 years ago
ad14de19c6
[imgur] support "unmuted" URLs
6 years ago
72e66f0aac
[simplyhentai] improve URL pattern
...
[ci skip]
6 years ago
cdcc3427a0
[simplyhentai] add video extractor ( #89 )
...
All videos hosted on their own servers seem be to dead,
but myhentai.tv embeds, which are most of the videos, work fine.
6 years ago
f9a6a19658
[simplyhentai] add image extractor ( #89 )
6 years ago
ebf596b399
[pawoo] restore metadata fields + smaller improvements
6 years ago
f7e7306e5a
[komikcast] update URL pattern and unescape image URLs
6 years ago
70f3617d88
[mangafox] fix URL extraction
6 years ago
a62bd81e9b
[pixiv] fix filter for 'type=all'
6 years ago
12797e3b1f
update configuration.rst
...
... again
- some more 'Path' references
- fixed some inconsistencies and errors
- added note about logging config for files
6 years ago
c43f02245f
update configuration.rst
...
- fix default values for 'log' and 'unsupportedfile'
[ci skip]
6 years ago
dacda69c9e
update configuration.rst
...
- document logging options
- add a section for "custom types"
[ci skip]
6 years ago
55b0913412
[simplyhentai] add gallery extractor ( #89 )
6 years ago
ae9a37a528
implement text.split_html()
6 years ago
Mike Fährmann