5ee8ca0319
release version 1.0.1
7 years ago
2c1adda784
update release.sh script
...
- update CHANGELOG on new releases
- change issue references to actual links
- replace "Unreleased" with new version and date
- fix filenames of old Windows executables
[no ci]
7 years ago
e913e5ec77
add a CHANGELOG
...
This is basically just a copy&paste from the Releases page, but it
has the benefits of (1) better visibility and (2) "forcing" me to
write a changelog section before releasing a new version and not
several days after.
7 years ago
42e948584d
fix downloader error handling
...
RequestException being a subclass of OSError caused all exceptions
during file downloads to be ignored/re-raised.
7 years ago
92027f67f9
use consistent names for URL constants
...
root := <scheme>://<host>
base_url := <root>/<common path>
7 years ago
69cbc0619f
[mangastream] fix 'next-page' URLs ( fixes #49 )
7 years ago
980fd3616d
[tumblr] use API v2 ( #48 )
7 years ago
d6bed9f36f
[tumblr] prevent premature exit to get all images ( fixes #48 )
7 years ago
305da540c3
[mangahere] fix metadata extraction
7 years ago
2d0cfb33e1
[xvideos] add user profile extractor ( #45 )
7 years ago
a393e6e538
[xvideos] add gallery extractor ( #45 )
7 years ago
3a8a0c1f35
[imgbox] rewrite / fix extraction ( closes #47 )
7 years ago
f97207a8e6
release version 1.0.0
7 years ago
a4bc5a3491
update setup.py and README.rst
7 years ago
707b15b586
create missing directories for 'part-directory'
...
also some code improvements regarding downloader config values
7 years ago
035ef655f1
[imagefap] update unit tests
...
old gallery/image has been deleted
7 years ago
caf26412dd
add option to set alternate location of .part files ( #29 )
...
Note: The path set for 'downloader.*.part-directory' needs to point to an
already existing directory.
7 years ago
ea8ca4cfa4
add 'util.expand_path()'
7 years ago
9a41002b77
fix partial downloads for 'text:' URLs
...
Using a filesize in bytes as offset into a Python string is not
a good idea if said file contains non-ASCII characters.
7 years ago
239d7afea7
[hosturimage] fix extraction of larger images
7 years ago
27c026543f
re-enable download unit tests
7 years ago
963670d73b
add options to control usage of .part files ( #29 )
...
- '--no-part' command line option to disable them
- 'downloader.http.part' and 'downloader.text.part' config options
Disabling .part files restores the behaviour of the old downloader
implementation.
7 years ago
158e60ee89
[3dbooru] enable download continuation
...
behoimi.org doesn't respect 'Range' headers and doesn't report
'Content-Length' for compressed content encodings.
7 years ago
b0353aa02d
rewrite download modules ( #29 )
...
- use '.part' files during file-download
- implement continuation of incomplete downloads
- check if file size matches the one reported by server
7 years ago
c4fcdf2691
Revert "[senmanga] fix extraction and download"
...
This reverts commit 2ace5c7b3c
7 years ago
81a7788b40
replace space characters in unit test URLs
7 years ago
bf82181359
[jaiminisbox] fix extraction
7 years ago
2e982f56af
use 'Content-Length' to determine incomplete downloads ( #29 )
7 years ago
16783e327f
[common] fix UnboundLocalError in Extractor.request()
7 years ago
2ace5c7b3c
[senmanga] fix extraction and download
7 years ago
4d8387f93b
[pixiv] support mobile URLs ( https://touch.pixiv.net/ )
7 years ago
ab2bf0b0dd
[deviantart] replace collection unittest
7 years ago
289d6b65d2
[danbooru] extend and improve URL regex
...
- add support for danbooru mirrors:
- hijiribe.donmai.us
- sonohara.donmai.us
- todo: actually use these domains instead of redirecting everything
to danbooru itself
- improve handling of query string parameters
7 years ago
5fa42336a2
[sankaku] add warning for unauthenticated users
...
also improve URL pattern and add missing options to default config file
7 years ago
6af921a952
[sankaku] rewrite/improve ( fixes #44 )
...
- add wait-time between HTTP requests similar to exhentai
- add 'wait-min' and 'wait-max' options
- increase retry-count for HTTP requests to 10
- implement user authentication (non-authenticated users can only view
images up to page 25)
- implement 'skip()' functionality (only works up to page 50)
- implement image-retrieval for pages >= 51
- fix issue with multiple tags
7 years ago
9aecc67841
[common] explicitly handle HTTP status code 429
7 years ago
abfd2924a9
update configuration.rst
...
- add instructions on how to register your own applications
- combine descriptions of a few config keys
7 years ago
d68a24aa70
[kissmanga] fix extraction
...
site changed '\n' to '\r\n' for newlines
7 years ago
864a63ed33
fix typo
...
[skip ci]
7 years ago
f3fbaa5c3e
[reddit] allow users to override the API User-Agent
...
Only overriding the Client-ID is not enough if you want to follow
Reddit's API access rules [1].
[1] https://github.com/reddit/reddit/wiki/API#rules
7 years ago
31ea6001e8
[dynastyscans] improve metadata and filename formats
7 years ago
2ef3c35c98
smaller textual changes
...
- swapped doc for deviantart.mature and .original
- updated gallery-dl.conf
- "transferred" -> "delegated"
7 years ago
68a0a7579c
fix/improve some regular expressions
7 years ago
832b8b76ac
[util] extend global namespace for filter expressions
7 years ago
393755ee94
[tumblr] update tests
7 years ago
75d3a1f72f
[deviantart] always download original images
...
Deviation-objects returned by the DeviantArt API don't always contain
the URL and metadata of the original image ([1]). Getting this
information requires an additional API call [2], which is indicated by
the 'is_downloadable' and 'download_filesize' metadata within a
deviation-object.
[1] https://myria-moon.deviantart.com/art/Aime-Moi-part-en-vadrouille-261986576
[2] https://www.deviantart.com/developers/http/v1/20160316/deviation_download/bed6982b88949bdb08b52cd6763fcafd
7 years ago
8e6a767109
[util] restructure formatter for better exception propagation
7 years ago
0386503c80
fix (sub)category-transfer for DownloadJob instances ( #41 )
...
... and extend "parent" parameters to TestJob- and DataJob-classes
as well.
7 years ago
a1c8b21cfd
[senmanga] improve metadata
7 years ago
8df023e144
[util:filter] re-enable builtins
...
Trying to restrict access to Python's builtin functions (exec,
print, __import__, ...) can easily be circumvented and is
therefore completely pointless.
This also adds 'safe_int()' and the 'datetime' module to the global
namespace used when evaluating filter expressions.
7 years ago
Mike Fährmann