Mike Fährmann
9e3415886c
[senmanga] fix/update tests
6 years ago
Mike Fährmann
973cf98e88
fix download skip for files without extension
6 years ago
Mike Fährmann
b8c97d2295
use 'extractor.request()' for more HTTP requests
6 years ago
Mike Fährmann
cc15c6105c
release version 1.4.1
6 years ago
Mike Fährmann
150a6b9064
[xvideos] fix metadata extraction
6 years ago
Mike Fährmann
7a98cc9798
[smugmug] update tests
...
My test account expired and all uploaded images got deleted.
6 years ago
Mike Fährmann
4eb94aca17
[postprocessor:ugoira] pass '-f' if not present
6 years ago
Mike Fährmann
0c1c4557dd
[postprocessor:ugoira] add option for two-pass encoding
6 years ago
Mike Fährmann
a9e276bc37
reset delete-flag
...
Since 'PathFormat' objects are being reused, setting `delete`
to True once caused all files downloaded after to be deleted as well.
6 years ago
Mike Fährmann
91340d9d27
[pixiv] fix ugoira test
6 years ago
Mike Fährmann
709c5d466d
add '--zip' and '--ugoira-conv' command-line options
6 years ago
Mike Fährmann
eb7a1f3b98
[pixiv] rework ugoira handling
...
Frame information now gets attached to the ZIP file's keyword dict
instead of being written to a separate text file.
6 years ago
Mike Fährmann
017188d268
improve extractor.request()
...
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
6 years ago
Mike Fährmann
b84e71da91
add postprocessor documentation to configuration.rst
6 years ago
Mike Fährmann
613b692275
[postprocessor:ugoira] add a few options
...
- ffmpeg-location: path to the ffmpeg (or avconv) executable
- ffmpeg-args: additional command line args for ffmpeg
- extension: filename extension of the resulting video file
6 years ago
Mike Fährmann
a444755979
[postprocessor] add 'ugoira' to convert pixiv animations to webm
6 years ago
Mike Fährmann
f10bd5cdbe
[4chan] unescape filenames
6 years ago
Mike Fährmann
eec081dd3e
[postprocessor:zip] delete directory ( #85 )
6 years ago
Mike Fährmann
2d1a104739
[mangadex] unescape manga names and chapter titles
...
pretty sure I previously tested if unescaping strings from the
embedded JSON object was necessary ... maybe they changed it
6 years ago
Mike Fährmann
3bcce77f6d
release version 1.4.0
6 years ago
Mike Fährmann
6ac403c5d3
add postprocessor config example
6 years ago
Mike Fährmann
2403c405e3
Merge branch 'postprocessor'
6 years ago
Mike Fährmann
baccf8a958
improve postprocessor handling
...
- add pathfmt argument for __init__()
- add finalization step
- add option to keep or delete zipped files
6 years ago
Mike Fährmann
2628911ba0
[pp:exec] add 'async' option
6 years ago
Mike Fährmann
7646bdbcfd
improve postprocessor initialization code
6 years ago
Mike Fährmann
b344f2290f
fix downloader tests
6 years ago
Mike Fährmann
37d97ff02c
[pp:classify] use temppath
6 years ago
Mike Fährmann
97189e50cd
[pp:zip] use temppath; add options
6 years ago
Mike Fährmann
821535b458
adjust PathFormat class
6 years ago
Mike Fährmann
a47c6136cd
[simplyhentai] avoid redirects for all-pages.json ( #89 )
6 years ago
Mike Fährmann
ad14de19c6
[imgur] support "unmuted" URLs
6 years ago
Mike Fährmann
72e66f0aac
[simplyhentai] improve URL pattern
...
[ci skip]
6 years ago
Mike Fährmann
cdcc3427a0
[simplyhentai] add video extractor ( #89 )
...
All videos hosted on their own servers seem be to dead,
but myhentai.tv embeds, which are most of the videos, work fine.
6 years ago
Mike Fährmann
f9a6a19658
[simplyhentai] add image extractor ( #89 )
6 years ago
Mike Fährmann
ebf596b399
[pawoo] restore metadata fields + smaller improvements
6 years ago
Mike Fährmann
f7e7306e5a
[komikcast] update URL pattern and unescape image URLs
6 years ago
Mike Fährmann
70f3617d88
[mangafox] fix URL extraction
6 years ago
Mike Fährmann
a62bd81e9b
[pixiv] fix filter for 'type=all'
6 years ago
Mike Fährmann
12797e3b1f
update configuration.rst
...
... again
- some more 'Path' references
- fixed some inconsistencies and errors
- added note about logging config for files
6 years ago
Mike Fährmann
c43f02245f
update configuration.rst
...
- fix default values for 'log' and 'unsupportedfile'
[ci skip]
6 years ago
Mike Fährmann
dacda69c9e
update configuration.rst
...
- document logging options
- add a section for "custom types"
[ci skip]
6 years ago
Mike Fährmann
55b0913412
[simplyhentai] add gallery extractor ( #89 )
6 years ago
Mike Fährmann
ae9a37a528
implement text.split_html()
6 years ago
Mike Fährmann
53f36176fd
update configuration.rst
...
- update the API Tokens & IDs section
- mention redirect URIs for deviantart
- include api-secret for tumblr
- add instructions for smugmug
- [ci skip]
6 years ago
Mike Fährmann
b08d95ebe4
add an 'encoding' option for logging files (default 'utf-8')
6 years ago
Mike Fährmann
513d807632
explicitly open config files as utf-8
6 years ago
Mike Fährmann
2df1a15fb8
add '-s/--simulate' to run data extraction without download
...
Useful for quick testing (even though -g and -j kind of do the same)
and to fill a download archive without actually downloading the files.
-s does the same as the default behaviour, except downloading stuff.
Maybe it should get a more fitting name, as it does actually write to
disk (cache, archive)?
6 years ago
Mike Fährmann
15cce22d82
[mangadex] fix parsing of unusual chapter strings
6 years ago
Mike Fährmann
ecdc3475b8
[pixhost] support .to TLDs
6 years ago
Elvis Yu-Jing Lin
aab2391c7b
Fix UnicodeDecodeError during installation ( #86 )
...
* fix UnicodeDecodeError during installation
* simplify opening with utf-8 encoding
6 years ago