91643ca54b
[nozomi] add search extractor ( #388 )
5 years ago
1adafdd3d0
document cache file requirement for DeviantArt refresh tokens
5 years ago
6779512fc7
[nozomi] add post and tag extractors ( #388 )
5 years ago
8af59a4bba
fix & update docs
...
- update Requests links
- add example for --exec
- set '-dev' version
5 years ago
46ba173ded
[reddit] fix documentation inconsistencies ( closes #429 )
...
- Require 'reddit.comments' to be a number and convert it to an
integer to be extra sure
- Link to the README's OAuth section were appropriate
5 years ago
5a1a0f5325
change text representation of user extractors to "User Profiles"
5 years ago
ee8b654464
[instagram] implement 'highlights' option ( closes #329 )
5 years ago
4330133114
[imgur] add 'favorite' extractor ( closes #420 )
...
… and use a newer site-internal API endpoint for user posts
5 years ago
b1cddce865
Revert "[simplyhentai] fix extraction; remove image+video extractors"
...
This reverts commit d1db5180ab
5 years ago
6fe9a134bf
[lineblog] add blog and post extractors ( closes #404 )
5 years ago
6f3df3999a
[fuskator] add gallery and search extractor ( closes #407 )
5 years ago
f02a768b5c
[danbooru] add 'ugoira' option ( #406 )
...
to choose between ZIP archives or converted video files
for Ugoira posts
5 years ago
c6c5cb1898
improve 'deviantart.quality' description
5 years ago
7c09545f70
[downloader:ytdl] add 'outtmpl' option ( #395 )
5 years ago
d1db5180ab
[simplyhentai] fix extraction; remove image+video extractors
5 years ago
b1728f512d
[patreon] support multi image posts and post URLs ( #383 )
5 years ago
5a210991b6
Remove control characters from filesystem paths
...
- add 'path-remove' option to specify the set of characters that
should be removed
- rename 'restrict-filenames' to 'path-restrict'
- #348 , #380
5 years ago
e661a1ce19
update links to Request's documentation
5 years ago
829b1ccf04
[imgur] distinguish album and gallery URLs ( #380 )
...
A gallery can be either an album or a single image.
5 years ago
42bb0cdb9b
Update gallery-dl.conf ( #378 )
5 years ago
2ccf6a9e35
[instagram] make extractor tests happy ( #373 )
5 years ago
8dc42bb178
implement 'enumerate' for 'extractor.skip' ( #306 )
...
[ci skip]
5 years ago
b7fb93e2b2
[downloader:http] add 'adjust-extensions' option
5 years ago
189acbeac9
[imgbb] add extractor for individual images ( closes #363 )
5 years ago
f687052daf
have e-hentai and exhentai on supportedsites.rst ( #365 )
5 years ago
3957d27d79
[deviantart] add 'quality' option ( #369 )
5 years ago
0609afd1e4
update default cache directory ... again
...
Use a 'gallery-dl' subdirectory in ~/.cache to adhere to how other
programs store their cached data, and call os.makedirs() so it also
works without an existing ~/.cache directory.
5 years ago
2c839f3760
[imgbb] add user extractor + login support ( #361 )
5 years ago
a8b60b2bd9
change default cache directory for unix systems
...
Use either $XDG_CACHE_HOME or ~/.cache (if the former isn't set)
and store potentially sensitive cookies and tokens in a user's
home directory and not in the world-readable /tmp.
5 years ago
2153206093
[imgbb] add album extractor ( #361 )
5 years ago
923e1bb714
[docs] Fix inconsistency about which sites have optional authentication ( #359 )
...
* [docs] Fix inconsistency about which sites have optional authentication
* update authentication docs
5 years ago
a90280f4e7
[postprocessor:zip] add 'mode' option ( #355 )
5 years ago
dc73d02d87
[exhentai] always use e-hentai.org as domain + set nw cookie
5 years ago
279db2c5b2
[vsco] add collection & image extractor + video support ( #331 )
5 years ago
547ea71463
[downloader.ytdl] add 'forward-cookies' option ( #352 )
...
The "long" name is necessary because just calling it 'cookies' would
clash with how the lookup for '--cookies' is implemented.
5 years ago
b1bea8aaeb
add 'restrict-filenames' option ( #348 )
5 years ago
60cf40380a
[vsco] add user extractor ( #331 )
5 years ago
3fe5ccdfa6
[adultempire] add gallery extractor ( closes #340 )
5 years ago
21991acc49
add 'ciphers' option; update default User-Agent
5 years ago
feb98cf196
[twitter] improve 'content' formatting; add option ( #338 )
...
- include emoticons
- leave newlines intact
- remove pic.twitter.com/ links at the end
5 years ago
8d1ae9b715
[tumblr] enable date-min/-max/-format options ( #337 )
5 years ago
fb875d1ab8
add warning about NSFW sites in supportedsites.rst ( #335 )
5 years ago
16c582aaf9
implement 'mtime' post-processor ( #332 )
...
This can set a file's modification time according to a UNIX timestamp
or a datetime object from its metadata.
5 years ago
62097284fe
add 'download' option ( #220 )
5 years ago
2ff73873f0
[erolord] add gallery extractor ( closes #326 )
5 years ago
b4da8c5a97
[sexcom] add extractor for related pins ( #325 )
5 years ago
69205df68d
allow '-1' for infinite retries ( #300 )
5 years ago
f7b5c4c3e7
use values of 'retries' options correctly
...
The RE-tries option now specifies exactly that: the maximum number a
failed HTTP request is re-tried. For example a value of 2 will now
correctly stop after 3 attempts: the initial one + 2 re-tries.
The maximum wait-time now also caps at 30min and increases exponentially
for both extractor.request() and downloader.http.download().
5 years ago
f2000a69aa
implement 'image-unique' and 'chapter-unique' options ( #303 )
...
The default value for both is 'false', i.e. duplicate URLs are NOT
ignored.
The previous behavior was to always ignore duplicate URLs to make
'--abort-on-skip' work properly when new images where added to the
beginning of a collection while gallery-dl is running.
5 years ago
40da44b17f
Merge branch 'v1.9.0'
5 years ago
a9c89085fb
[instagram] implement login support ( #195 )
5 years ago
18a1f8c6cd
[vanillarock] add post and tag extractors ( closes #254 )
5 years ago
f0c5093812
[nsfwalbum] add album extractor ( closes #287 )
5 years ago
15e4ddf46d
implement custom logging formatter
...
supports custom log message formats for each loglevel and, by
extension, custom ANSI codes and colors for errors and warnings
(#304 )
5 years ago
db3f52881a
add 'mtime' option
5 years ago
ec3e8601f1
[slickpic] add user extractor ( #249 )
5 years ago
d997c10320
[8muses] add album extractor ( #305 )
5 years ago
e05a96db5e
[deviantart] rename 'stash' to 'extra' ( #302 )
...
'stash' is already used as a name for the StashExtractor and therefore
expected to be a dictionary.
5 years ago
2184e3a86b
[slickpic] add album extractor ( #249 )
5 years ago
c23bf263fe
[deviantart] rename 'external' to 'stash' ( #302 )
...
restrict extracted URLs to ones from https://sta.sh/ ...
5 years ago
c73c2cda50
[pornhub] add gallery & user extractor ( #282 )
5 years ago
035b850e82
update postprocessor entries in example config
...
- use whitelists
- add ugoira example (#299 )
5 years ago
2fb85178da
[deviantart] add 'external' option ( #302 )
...
If a description is available, this will extract URLs from the
description text and try to find Extractors for them.
5 years ago
096009367b
[xhamster] add gallery & user extractor ( #281 )
5 years ago
d33f5a7423
[wallhaven] rewrite
...
- use API
- remove login support, add 'api-key' option
- remove support for "alpha" subdomain - alpha.wallhaven.cc used numeric
IDs that can't be translated to the new ID system
- support direct links to wallpapers
5 years ago
f1893b2b5b
[deviantart] add 'folders' option ( #276 )
5 years ago
c849574def
[keenspot] add comic extractor ( #223 )
...
Doesn't work for
- http://brawlinthefamily.keenspot.com/
- http://flipside.keenspot.com/
- http://lastblood.keenspot.com/
- http://mysticrevolution.keenspot.com/
- http://porcelain.keenspot.com/
- http://twokinds.keenspot.com/
yet, because of custom layouts.
5 years ago
bcd1801aa8
[sankakucomplex] add 'tag' extractor ( #258 )
5 years ago
74c2415138
[sankakucomplex] move article extractor to its own module ( #258 )
5 years ago
4465a3ea68
[kissmanga][readcomiconline] add 'captcha' option ( #279 )
...
to configure how to handle CAPTCHA page redirects:
- either interactively wait for the user to solve the CAPTCHA
- or raise StopExtraction like before
5 years ago
1e3e15c4f3
[sankaku] add article extractor ( #258 )
5 years ago
e82cadac61
[patreon] add extractors ( #226 )
5 years ago
4891f4a328
[hentainexus] add search extractor ( #256 )
5 years ago
9890bfdf23
[flickr] improve code and metadata
...
- simplify pagination
- add more metadata and slightly change its structure
- convert suitable values to int or list
- move keys from ["photo"] to the base level
- proper video support (#246 )
- rename method and variable names to better fit with other extractors
5 years ago
ba8eb1ffec
[hentainexus] add gallery extractor ( #256 )
5 years ago
0318c610dc
[sexcom] add extractor for search results ( #147 )
5 years ago
a247c94c34
[sexcom] add pin and board extractors ( #147 )
5 years ago
70be494161
[plurk] add a 'comments' options ( #212 )
6 years ago
0b2ff406f6
[plurk] add timeline- and post-extractors ( #212 )
6 years ago
e7cd5510d5
[pixnet] add extractors ( closes #177 )
...
for:
- users/blogs: http://albertayu773.pixnet.net/
- folders: https://albertayu773.pixnet.net/album/folder/1405768
- sets : https://albertayu773.pixnet.net/album/set/15078995
- photos : https://albertayu773.pixnet.net/album/photo/159443828
6 years ago
d9b94a585d
[mangoxo] add login support ( #184 )
...
A very recent change: It is now only possible to see more
than the first 5 images of an album if you are logged in.
6 years ago
e730fc9045
[twitter] add login support ( #214 )
6 years ago
35919a9bb8
[livedoor] add blog- and post-extractors ( #190 )
6 years ago
2ff043edfa
[yaplog] add user- and post-extractors ( #190 )
6 years ago
790f15a56f
[photobucket] use HTTPS
6 years ago
6da665f32e
[mangoxo] add album- and channel-extractors ( closes #184 )
6 years ago
c70b21248d
[wikiart] add extractors ( #179 )
...
for
- artists: https://www.wikiart.org/en/thomas-cole
- artist-listings: https://www.wikiart.org/en/artists-by-century/12
- artwork-listings: https://www.wikiart.org/en/paintings-by-media/grisaille
6 years ago
bc2020e86c
release version 1.8.1
6 years ago
369eb66125
consistently use '*' for rst lists
6 years ago
c7a6b0ed90
[deviantart] add 'metadata' option ( #189 )
6 years ago
8d96a8ce4c
[500px] add user-, gallery-, and image-extractors ( #185 )
6 years ago
6277a739e4
[35photo] add user-, genre-, and image-extractors ( #162 )
6 years ago
12482553bd
update links to youtube-dl
6 years ago
6f57d44ec2
[seaotterscans] remove extractor
...
http://seaotterscans.com/ now redirects to their MangaDex profile
6 years ago
25aaf55514
[smugmug] improve format selection ( closes #183 )
...
- use original image if available
- support video formats
- remove user info for ImageExtractor (it is no longer possible to get
image owner information for a single image)
6 years ago
976ccb267f
[myportfolio] combine gallery and user extractors
...
An URL alone isn't good enough to distinguish between a gallery or a
gallery-listing, so the new extractor decides what to do based on the
page's content.
6 years ago
9c0e2f294b
[shopify] add generic collection and product extractors ( #175 )
...
with fashionnova.com as a default domain
6 years ago
13e0f2a78f
[deviantart] add 'scraps' extractor ( closes #168 )
6 years ago
280531c8ff
[pururin] add gallery extractor ( closes #174 )
6 years ago
3159dd79d5
[seiga] use HTTPS
6 years ago
Mike Fährmann