4f1e6c109f
[deviantart] remove 'invalid escape sequence' warning
...
- use r"\w" or "\\w" instead of "\w"
7 years ago
c864be479e
[directlink] update URL pattern & PEP 8
...
- combine some file extensions
- don't match '.je'
- line length < 80
7 years ago
45f9d64c23
Update directlink.py with additional file exts. ( #30 )
...
Add WebP, still not that common, but it's increasing.
Add 3rd JPEG variant (https://en.wikipedia.org/wiki/JPEG#JPEG_filename_extensions )
Never seen JFIF in the wild, would probably be overkill.
Extend Ogg formats (https://en.wikipedia.org/wiki/Ogg ; https://wiki.xiph.org/MIME_Types_and_File_Extensions )
7 years ago
4357966a70
[kissmanga] make URL pattern case-insensitive (fixes 28)
7 years ago
493bd235cf
workaround for missing 'assert_called_once' method
...
this method was introduced in Python 3.6, but calling it still
works (i.e. it doesn't cause the test to fail) on Python 3.3/3.4
7 years ago
7aa9fa796a
code cleanup and fixes
7 years ago
f08af03845
Merge branch 'cookies'
7 years ago
6db93a8b9e
add cookie tests
7 years ago
55f048d02b
ignore case of cookiejar magic strings
7 years ago
de68cf84a8
release version 0.9.1
7 years ago
d7cb3c668a
update supportedsites.rst
7 years ago
f53bf1a323
[thebarchive] add thread extractor
7 years ago
b8cf434bb0
[rebeccablacktech] add thread extractor
7 years ago
808f67ba7d
use 'cookiedomain' for cookies set by object-config-values
...
otherwise these cookies would not be picked up by the
_check_cookies() method.
7 years ago
00a23fe208
update configuration.rst
7 years ago
390eeded4c
[mangazuki] support 'raws.…' subdomain
7 years ago
4a60f6068a
[mangazuki] add manga extractor
7 years ago
394241cd6f
[2chan] fix extraction
7 years ago
a13eb6010f
[fallenangels] fix extraction of chapter URLs
7 years ago
1cb1d2e0a3
[mangazuki] add chapter extractor
7 years ago
2f2e363c97
[imgur] use /a/<key>/all as album-url
7 years ago
1cec03c9c6
[imgur] fix extraction of large albums
7 years ago
0610ae5000
skip login if cookies are present
7 years ago
74a2b5af06
update supportedsites.rst
7 years ago
f105782435
[fireden] add thread extractor
7 years ago
c93f7d7496
[archiveofsins] add thread extractor
7 years ago
96e13604da
[archivedmoe] add thread extractor
7 years ago
30d3a5f9b2
support redirects on 4chan archives
7 years ago
98464d1f1b
[loveisover] add thread extractor
7 years ago
47692f28da
[2chan] add thread extractor
7 years ago
3460dc8950
update gallery-dl.conf
7 years ago
9be8f7e106
[deviantart] add "extractor.deviantart.flat" option
...
Setting this to 'false' downloads images into individual subdirectories
for each gallery-folder or favourite-collection, otherwise it is just
creating a flat list of images.
7 years ago
d075627fd9
[deviantart] support group galleries ( #26 )
...
For groups the 'GalleryExtractor' collects all gallery-folder URLs
and defers its work to the 'FolderExtractor'.
7 years ago
b37a62501b
[pixiv] unquote tags
7 years ago
fbd7dcdfdb
[desuarchive] add thread extractor
7 years ago
af9bd17b19
[deviantart] adjust default paths
...
- user.deviantart.com/(gallery|favourites|journal)/ images go into
* <user>/
* <user>/Favourites/
* <user>/Journal/
(having an extra "Gallery" folder for a user's gallery-images seems
a bit too much if these are all you want to download, which is
probably the default use-case)
- single "deviations" (user.deviantart.com/(art|journal)/name-123) go
into their owner's directory:
* <user>/
(putting them into their own directory seems weird in practice)
7 years ago
eb64fb267c
[nyafuu] add thread extractor ( #18 )
7 years ago
726c6f01ae
allow 'cookies' config option to be a dictionary
7 years ago
4877ef6314
[deviantart] support '?catpath=/' URLs ( #26 )
...
They previously weren't supported for galleries and journals.
This also increases the 'limit' parameter for API calls to its
respective maximum.
7 years ago
9edbd6ff01
update configuration.rst
7 years ago
8c16cbe7ea
fix tests
7 years ago
a6f689e01a
[deviantart] add gallery-folder extractor ( #26 )
...
The code for this and the available metadata is probably going
to change again. This extractor is very similar to the favorite-
extractor, so they might be "combined" or something like that.
7 years ago
474e9c1aec
[4plebs] add thread extractor ( #18 )
7 years ago
a804a42e23
add '--cookies' command-line option
7 years ago
dcc1d3b2ea
[hentaifoundry] fix infinite loop for multiple of 25 images
7 years ago
ce55ec6490
enable extractor tests without filters
...
$ python test_extractors.py all
7 years ago
34e6e1099e
[batoto] adapt to https chapter URLs
7 years ago
85696d0b3b
[reddit] fix issue with datetime errors
7 years ago
80c2e03aaa
[reddit] allow 'date-min/max' to be human readable dates
...
If the date-min/max config value is a string, try parsing it using
datetime.strptime [1] with 'date-format' as format string [2]
(default: "%Y-%m-%dT%H:%M:%S")
Example: get all submissions posted in 2016
$ gallery-dl reddit.com/r/... \
-o date-format=%Y \
-o date-min=\"2016\" \
-o date-max=\"2017\"
[1] https://docs.python.org/3/library/datetime.html#datetime.datetime.strptime
[2] https://docs.python.org/3/library/datetime.html#strftime-strptime-behavior
7 years ago
58e95a7487
share extractor and downloader sessions
...
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
7 years ago
Mike Fährmann