Mike Fährmann
8c20443839
release version 1.8.0
6 years ago
Mike Fährmann
973a720a7a
[weibo] fix unit test URL patterns
6 years ago
Mike Fährmann
a2af2d2965
adjust cache maxage values
6 years ago
Mike Fährmann
f612284d24
cache cfclearance cookies
6 years ago
Mike Fährmann
34ea0d6a10
rewrite cache module
...
less complexity, better performance,
but some duplicate code here and there
6 years ago
Mike Fährmann
12482553bd
update links to youtube-dl
6 years ago
Mike Fährmann
591a07f20c
small code changes and cleanups
6 years ago
Mike Fährmann
6f57d44ec2
[seaotterscans] remove extractor
...
http://seaotterscans.com/ now redirects to their MangaDex profile
6 years ago
Mike Fährmann
6dae6bee37
automatically detect and bypass cloudflare challenge pages
...
TODO: cache and re-apply cfclearance cookies
6 years ago
Mike Fährmann
25aaf55514
[smugmug] improve format selection ( closes #183 )
...
- use original image if available
- support video formats
- remove user info for ImageExtractor (it is no longer possible to get
image owner information for a single image)
6 years ago
Mike Fährmann
7c1cb923a4
[myportfolio] replace unit test
...
the old gallery got removed
6 years ago
Mike Fährmann
fffbfd3dce
[imgspice] fix extraction
6 years ago
Mike Fährmann
4ca4631bad
simplify auto-disabling certificate verification
...
if no certificate bundle is found
6 years ago
Mike Fährmann
09d872a2b1
generalize extractor creation code
6 years ago
Mike Fährmann
8dc6be246b
[shopify] add custom retry logic for 430 status codes ( #175 )
6 years ago
Mike Fährmann
0887fb61f4
[komikcast] update test results
6 years ago
Mike Fährmann
976ccb267f
[myportfolio] combine gallery and user extractors
...
An URL alone isn't good enough to distinguish between a gallery or a
gallery-listing, so the new extractor decides what to do based on the
page's content.
6 years ago
Mike Fährmann
efd104e45e
[instagram] reject more non-user URLs ( #180 )
6 years ago
HRXN
56e0e92e0d
[shopify] cosmetic changes in shopify.py ( #181 )
...
Glanced over the commits, randomly spotted some minor things.
6 years ago
Mike Fährmann
23baecb29e
fix 'CONVERSIONS' variable name
6 years ago
Mike Fährmann
9c0e2f294b
[shopify] add generic collection and product extractors ( #175 )
...
with fashionnova.com as a default domain
6 years ago
Mike Fährmann
105097ddcf
add 'S' conversion options for format string fields
...
Same as 's' (convert to string), but has a better, human-readable
conversion for lists.
6 years ago
Mike Fährmann
1578013efc
remove unused default config path
6 years ago
Mike Fährmann
26c4365baa
adjust metadata types for GalleryExtractors
6 years ago
Mike Fährmann
13e0f2a78f
[deviantart] add 'scraps' extractor ( closes #168 )
6 years ago
Mike Fährmann
3ea11f5d5e
[nhentai] rewrite
...
- use GalleryExtractor as base class
- extract a lot more metadata (artist, tags, etc.)
6 years ago
Mike Fährmann
176b7253a1
update function signature for config.load()
6 years ago
Mike Fährmann
3595cd582f
use GalleryExtractor as common base class
6 years ago
Mike Fährmann
a138d5873d
[hentaifoundry] improve/fix extraction
...
- Sometimes an ad interfered when trying to get a download URL
- Resolving "www.hentai-foundry.com" yields an invalid(?) IPv6 address
(2607:5300:60:ca9e:feed:dead:beef:1) and urllib3 only tries to connect
to the IPv4 variant after a rather long wait time
6 years ago
Mike Fährmann
280531c8ff
[pururin] add gallery extractor ( closes #174 )
6 years ago
Mike Fährmann
3159dd79d5
[seiga] use HTTPS
6 years ago
Mike Fährmann
f6734142ee
[komikcast] remove 'width' and 'height' info
6 years ago
Mike Fährmann
d0059cab79
[tumblr] check for null URLs ( closes #165 )
6 years ago
Mike Fährmann
e687a6095e
[luscious] raise exception if album is not available
6 years ago
Mike Fährmann
22d3a2fcc8
[artstation] add extractor for artwork listings ( #80 )
...
like https://www.artstation.com/artwork?sorting=latest
or https://www.artstation.com/artwork?sorting=picks
6 years ago
Mike Fährmann
937a802b49
[dynastyscans] add extractors for images and image searches
...
(closes #163 )
6 years ago
Mike Fährmann
b09a8184ca
move TestJob into test module; test _extractor values
6 years ago
Mike Fährmann
19860655a3
[weibo] add 'user' and 'status' extractors
6 years ago
Mike Fährmann
f8782c05f2
[paheal] rename "tags" to "search_tags"
...
to better match field names of other booru extractors
6 years ago
Mike Fährmann
c7b8421333
[deviantart] don't match 'www' as a potential username
6 years ago
Mike Fährmann
5530871b5a
change results of text.nameext_from_url()
...
Instead of getting a complete 'filename' from an URL and splitting that
into 'name' and 'extension', the new approach gets rid of the complete
version and renames 'name' to 'filename'. (Using anything other than
{extension} for a filename extension doesn't really work anyway)
Example: "https://example.org/path/filename.ext "
before:
- filename : filename.ext
- name : filename
- extension: ext
now:
- filename : filename
- extension: ext
6 years ago
Mike Fährmann
148b8f15d0
update tests for util.py
6 years ago
Mike Fährmann
ae353ed3b0
provide "extractor" and "job" keys for logging output
...
This allows for stuff like "{extractor.url}" and "{extractor.category}"
in logging format strings.
Accessing 'extractor' and 'job' in any way will return "None" if those
fields aren't defined, i.e. in general logging messages.
6 years ago
Mike Fährmann
32edf4fc7b
add '_extractor' info to manga extractor results
6 years ago
Mike Fährmann
89ee8cd7e4
filter "private" kwdict entries
6 years ago
Mike Fährmann
61741d7333
provide type information for Queue messages
...
Child extractors are now directly constructed with Extractor.from_url()
if the extractor class is known beforehand, instead of using
extractor.find() and searching through all possible extractor classes.
6 years ago
Mike Fährmann
2e516a1e3e
store the full original URL in Extractor.url
6 years ago
Mike Fährmann
580baef72c
change Chapter and MangaExtractor classes
...
- unify and simplify constructors
- rename get_metadata and get_images to just metadata() and images()
- rename self.url to chapter_url and manga_url
6 years ago
Mike Fährmann
4b1880fa5e
propagate 'match' to base extractor constructor
6 years ago
Mike Fährmann
ade86da7a1
[tsumino] replace test
6 years ago
Mike Fährmann
1f3422c28b
[mangahere] fix extraction
6 years ago
Mike Fährmann
84ae72b8d8
[ngomik] fix extraction
6 years ago
Mike Fährmann
02d733d219
[simplyhentai] fix and improve tag extraction
...
The "tags" field is now a list instead of a string.
In format strings, use "{tags:J, }" to Join them.
6 years ago
Mike Fährmann
3a0b4af744
[seiga] recognize /thumb/ URLs
...
https://lohas.nicoseiga.jp/thumb/5977527i
6 years ago
Mike Fährmann
8fc6fbfa34
[artstation] recognize shortened project URLs
...
https://artstn.co/p/ <project-id>
6 years ago
Mike Fährmann
9a9cd32461
implement alternative constructor for extractors
6 years ago
Mike Fährmann
abbd45d0f4
update handling of extractor URL patterns
...
When loading extractor classes during 'extractor.find(…)', their
'pattern' attribute will be replaced with a compiled version of itself.
6 years ago
Mike Fährmann
6284731107
simplify extractor constants
...
- single strings for URL patterns
- tuples instead of lists for 'directory_fmt' and 'test'
- single-tuple tests where applicable
6 years ago
Mike Fährmann
34bab080ae
rewrite URL patterns to use only 1 per extractor
6 years ago
Mike Fährmann
0e46db6f45
rename some base classes
...
They shouldn't be called …Extractor if they don't have 'Extractor' as
their base class.
6 years ago
Mike Fährmann
793b24e513
[imagehosts] fix and improve various extractors
6 years ago
Mike Fährmann
bc0951d974
allow for simplified test data structures
...
Instead of a strict list of (URL, RESULTS)-tuples, extractor result
tests can now be a single (URL, RESULTS)-tuple, if it's just one test,
and "only matching" tests can now be a simple string.
6 years ago
Mike Fährmann
b49c3c9991
release version 1.7.0
6 years ago
Mike Fährmann
050bc1aa4a
[reactor] simplify tests
...
Some posts have, for whatever reason, a slightly different text
formatting the first time they are accessed that day
compared to any further time.
6 years ago
Mike Fährmann
2f3a021d72
[hentaicafe] restore functionality
6 years ago
Mike Fährmann
347398f692
fix various tests
6 years ago
Mike Fährmann
00dc37ccbf
replace AsynchronousMixin Extractor with a Mixin
6 years ago
Mike Fährmann
4d656a81ca
replace SharedConfigExtractor class with a Mixin
6 years ago
Mike Fährmann
ccb95d0ba4
[mastodon] changes/improvements based on foolfuuka/-slide
6 years ago
Mike Fährmann
12ff750111
[foolfuuka] smaller code changes and updates
6 years ago
Mike Fährmann
e1bf3b225e
[foolslide] dynamically generate extractor classes
6 years ago
Mike Fährmann
58a9eede38
[foolfuuka] dynamically generate extractor classes
6 years ago
Mike Fährmann
22d7a783d5
update extraction result tests
6 years ago
Mike Fährmann
197d0e99a4
[tsumino] more useful error message ( #161 )
...
if Tsumino suspects a non-human user and refuses to send gallery pages
6 years ago
Mike Fährmann
d36ec51e5a
[tsumino] add extractor for search results ( #161 )
6 years ago
Mike Fährmann
1c1367ec5b
[behance] fix empty docstring
6 years ago
Mike Fährmann
45e529ab91
[behance] fix extraction
...
HTML structure for gallery pages changed quite a bit, so it is now using
the embedded JSON data. This changes a lot of metadata field names, but
'gallery_id', 'title', and 'user' are still provided for backwards
compatibility.
The internal API endpoint for user galleries also changed its data
structure, but nothing too major.
6 years ago
Mike Fährmann
e1d3e9a926
add 'ext_from_url' to text.py
6 years ago
Mike Fährmann
bfbbac4495
[tsumino] add login capabilities ( #161 )
6 years ago
Mike Fährmann
dd358b4564
improve cookie handling during logins
6 years ago
Mike Fährmann
6126615698
update URLs for supportedsites.rst
6 years ago
Mike Fährmann
80a75a1ecf
[tsumino] add gallery extractor ( #161 )
6 years ago
Mike Fährmann
2d2953a5bf
add 'text.parse_float()' + cleanup in text.py
6 years ago
Mike Fährmann
0c32dc5858
[hentaifox] add extractor for search results ( #160 )
6 years ago
Mike Fährmann
580947bfce
[hentaifox] rename Chapter- to GalleryExtractor ( #160 )
6 years ago
Mike Fährmann
8095f5f81a
[mangapark] fix manga title extraction
6 years ago
Mike Fährmann
0156189468
[hentaifox] add chapter extractor ( #160 )
6 years ago
Mike Fährmann
e4171d6baf
[luscious] add login capabilities ( closes #159 )
6 years ago
Mike Fährmann
4f49fdf065
[mastodon] various improvements and fixes ( #144 )
...
- allow instances to specify their own 'category'
- improve config lookup:
- first look into extractor.<category>.*
- and afterwards look into extractor.mastodon.<instance>.*
- add a default entry for pawoo.net in a way that actually works
- add an 'instance' keyword and turn 'tags' into a usable list
6 years ago
Mike Fährmann
3f608a84b7
[photobucket] don't crash if JSON data is missing
6 years ago
Mike Fährmann
134487ffb0
[exhentai] stop extraction if image limit is exceeded ( #141 )
...
can be turned off with the `exhentai.limits' option
6 years ago
Mike Fährmann
e868fb4393
[exhentai] improve gallery extraction
...
- match image page URLs and extract galleries from that point onward
- add a few more metadata entries: 'parent', 'visible', 'cost'
6 years ago
Mike Fährmann
a50e9faf0e
[newgrounds] recognize direct links
6 years ago
Mike Fährmann
9fba48fbd7
[postprocessor:metadata] add '--write-tags' flag ( #135 )
6 years ago
Mike Fährmann
c5559fa07d
[photobucket] improve subalbum extraction ( #117 )
...
The former implementation would produce a complete list of all subalbums
for each (sub)album extraction. This would for example result in a
level 2 subalbum getting "extracted" twice: once through the root-album
(level 0) and once through its parent album on level 1.
In the current implementation only the next level of subalbums are
returned, which themselves will handle their next level in a recursive
fashion.
6 years ago
Mike Fährmann
ecad69100a
[photobucket] add 'image' extractor ( #117 )
6 years ago
Mike Fährmann
b50b30f1c9
[photobucket] download subalbums ( #117 )
6 years ago
Mike Fährmann
d19bac71be
[photobucket] add 'album' extractor ( #117 )
6 years ago
Mike Fährmann
78b5f29a00
[sankaku] unescape tags
6 years ago
Mike Fährmann
277b52101a
add 'category-transfer' option
...
[ci skip]
6 years ago
Mike Fährmann
9b8ac12eed
[behance] enable 'categorytransfer' for collections ( #157 )
6 years ago
Mike Fährmann
217a0687ef
[behance] add 'collection' extractor ( closes #157 )
6 years ago
Mike Fährmann
b8fed34548
add generalized extractors for Mastodon instances ( #144 )
...
Extractors for Mastodon instances can now be dynamically generated,
based on the instance names in the 'extractor.mastodon.*' config path.
Example:
{
"extractor": {
"mastodon": {
"pawoo.net": { ... },
"mastodon.xyz": { ... },
"tabletop.social": { ... },
...
}
}
}
Each entry requires an 'access-token' value, which can be generated with
'gallery-dl oauth:mastodon:<instance URL>'.
An 'access-token' (as well as a 'client-id' and 'client-secret') for
pawoo.net is always available, but can be overwritten as necessary.
6 years ago
Mike Fährmann
4b441c162e
release version 1.6.3
6 years ago
Mike Fährmann
66460337f1
[mangapark] fix extraction
6 years ago
Mike Fährmann
8aba2bdebf
[postprocessor:metadata] add 'tags' and 'custom' modes ( #135 )
6 years ago
Mike Fährmann
79c01ec7ae
implement J<separator>/ format option
...
J joins list elements by calling <separator>.join(list):
Example:
{f:J - /} -> "a - b - c" (if "f" is ["a", "b", "c"])
6 years ago
Mike Fährmann
2ffc105887
[exhentai] extract tag metadata
6 years ago
Mike Fährmann
0fb98d1d79
[hbrowse] extract tag metadata
6 years ago
Mike Fährmann
9bbbadd93a
[hbrowse] use HTTPS
6 years ago
Mike Fährmann
2fbf072723
[newgrounds] ensure consistent tag order
...
... plus some code restructuring
6 years ago
Mike Fährmann
d7a4739cf6
[hbrowse] print error message if site is down
...
... instead of crashing with a meaningless exception
6 years ago
Mike Fährmann
98c6520384
[pinterest] update root URL of API calls
6 years ago
Mike Fährmann
751e535948
[nhentai] fix extraction ( closes #156 )
...
Use JSON embedded in webpage since API endpoints have been disabled
6 years ago
Mike Fährmann
5f38ac9609
[postprocessor:exec] add a better error message ( #155 )
6 years ago
Mike Fährmann
89df37a173
[artstation] use a separate dict for each asset ( #154 )
...
Using the same base-dict for each asset of a project causes unwanted
side effects like re-using image filename extensions for videos,
resulting in errors with the youtube-dl downloader.
6 years ago
Mike Fährmann
344bbaa71a
remove useless line
...
A remnant from when `filter` and `range` were global and only
available as command line options.
6 years ago
Mike Fährmann
1734a6c879
[reactor] detect "circular" redirects ( #148 )
6 years ago
Mike Fährmann
e53cdfd6a8
update build_supportedsites.py
6 years ago
Mike Fährmann
1e4d351ad3
[danbooru] add authentication support ( closes #151 )
...
... via HTTP Basic Auth with username and "password".
The password value in this case is not the account password itself,
but the"api_key" found in your user profile.
6 years ago
Mike Fährmann
06cbf5f9c4
implement 'chapter-reverse' option ( #149 )
...
Setting it to `true` will start with the latest chapter instead of the
first one.
6 years ago
Mike Fährmann
e95b24f056
[reactor] add wait-min & -max options ( #148 )
6 years ago
Mike Fährmann
8e01cf0ef8
[reactor] generalize extractors ( #148 )
...
- support *.reactor.cc domains
- combine joyreactor and pornreactor modules
6 years ago
Mike Fährmann
38500ad697
[postprocessor:metadata] first implementation ( #135 )
6 years ago
Mike Fährmann
1737d7f576
[joyreactor] fix and improve pagination ( #148 )
6 years ago
Mike Fährmann
8753627ef4
[joyreactor] improve error handling for faulty JSON ( #148 )
...
- remove all ASCII escape codes, not just \n and \r
- ignore faulty posts instead of letting the exception propagate
6 years ago
Mike Fährmann
a36f52a730
[joyreactor] add extractor for search results ( #148 )
6 years ago
Mike Fährmann
a303efb597
[mangadex] handle manga pages without chapters
6 years ago
Mike Fährmann
0afa913de4
[tumblr] add tests for hidden and private blogs ( #145 )
...
Hidden / dashboard-only blogs are pretty straightforward and "only"
require a valid 'access-token' and 'access-token-secret' for the given
'api-key' and 'api-secret', so that signed OAuth1.0 requests are possible.
Private / password protected blogs on the other hand are a bit
cumbersome. In addition to a valid 'access-token' and
'access-token-secret', they also require the account belonging to those
tokens to be a member of the blog itself. Knowing the password and
entering it in the website isn't enough to access a blog through the
API. Following a private blog is also impossible, so that option can't
work either.
6 years ago
Mike Fährmann
67cc0ac873
release version 1.6.2
6 years ago
Mike Fährmann
fa7fa2f8ff
[deviantart1 update tests]
6 years ago
Mike Fährmann
b7b5456a32
[kissmanga] use HTTPS
6 years ago
Mike Fährmann
259123732f
[readcomiconline] improve comic-page parsing
6 years ago
Mike Fährmann
0328a04a65
[cloudflare] don't output the whole challenge page
...
thanks to the embedded animated gifs this is just a bit too much
6 years ago
Mike Fährmann
4ab0960083
[reddit] add metadata to extracted URLs
6 years ago
Mike Fährmann
2f4f60de33
[tumblr] add tests for each post type
6 years ago
Mike Fährmann
98314aa04c
[mangapark] detect non-existent chapters
6 years ago
Mike Fährmann
6c71e9cf5d
[deviantart] add separate 'sta.sh' extractor ( #113 )
...
- supports multiple stashed deviations per page
- explicitly mentions sta.sh support on supportedsites.rst
6 years ago
Mike Fährmann
f9ace0f4a3
[mangapark] fix manga extraction ... again
6 years ago
Mike Fährmann
28f9539551
[tumblr] change default values for post types and inline media
6 years ago
Mike Fährmann
5be95034ba
[tumblr] add option to download avatars ( #137 )
6 years ago
Mike Fährmann
7471933d5f
use extractor.request for all other API calls
...
- deviantart
- pawoo
- pixiv
- reddit
6 years ago
Mike Fährmann
995844c915
[instagram] relax test pattern even more
6 years ago
Mike Fährmann
2e5f82e59e
[tumblr] don't follow 'external' Tumblr URLs ( #139 )
6 years ago
Mike Fährmann
c5d4f558c9
allow missing field access keys in format strings ( #136 )
6 years ago
Mike Fährmann
0c9762f00e
[mangapark] fix extraction
6 years ago
Mike Fährmann
c9ef5ed364
[luscious] ensure URLs have a scheme
6 years ago
Mike Fährmann
851ee9f89f
[sensescans] replace tests
...
the old ones got removed
6 years ago
Mike Fährmann
c14d44e1bc
[downloader:common] retry downloads on SSL errors ( #130 )
6 years ago
Mike Fährmann
0be7ee3106
[hitomi] fix image subdomains ( closes #142 )
...
galleries with an ID ending in 1 need some special treatment
6 years ago
Mike Fährmann
fe96835d25
[kissmanga] add fallback for chapter-string parsing ( #20 )
6 years ago
Mike Fährmann
4d73cc785d
update test results
6 years ago
Mike Fährmann
049a9575c4
[tumblr] fix inline extraction #2
...
Using only the "comment" field isn't enough ...
[ci skip]
6 years ago
Mike Fährmann
f6bf66f72c
[pixiv] create directory for each "work" item ( #136 )
6 years ago
Mike Fährmann
79f6755c60
[postprocessor:classify] handle missing "extension" ( #138 )
6 years ago
Mike Fährmann
b7a9f6cc49
[tumblr] improve inline extraction ( #137 )
6 years ago
Mike Fährmann
010da8372a
[instagram] relax test pattern
6 years ago
Mike Fährmann
1c6b9ba322
[readcomiconline] use HTTPS
6 years ago
Leonardo Taccari
2655a2ea02
Add support for instagram.com user profiles and pages ( #134 )
...
* [instagram] Add extractor for instagram.com user profiles and pages
The extractor scrapes `instagram.com/<user>' timelines and
`instagram.com/p/<shortcode>' by mimicking the behaviour of a web
browser and extracting the sharedData JSON of the single pages.
Please note that this mean that for user timelines we also do an
extra request to the `instagram.com/p/<shortcode>' page but this
permit to have consistent (and all) information about the media
fetched.
The MD5 logic used for X-Instagram-GIS was documented in
<https://stackoverflow.com/questions/49786980/ >
* [instagram] Test for keywords, not url for GraphImage and GraphSidecar
URLs returned by instagram seems not stable so avoid testing for
them and instead test for keyword returned.
* [instagram] Improve test of InstagramProfilepageExtractor
Also check the count of media returned.
* [instagram] Several cleanup and improvements
- Change description, subcategories to generate a better description in
docs/supportedsite.rst
- Remove not needed InstagramExtractor.__init__()
- Use text.parse_int() instead of directly using int() (the former is more
robust)
- Use self.request().json() instead of using json.loads() the
self.request().text()
- Add `pattern:' to check the URLs where we do not have a stable URLs.
It seems that only the subdomain is not stable.
Thanks to @mikf!
6 years ago
HRXN
e80ee77d71
tumblr.py: update regex for video ( #133 )
...
There seems to be another sub-domain for videos, apparently..
Not just
`vt(.media).tumblr`
`vtt(media).tumblr`
But also
`ve(.media).tumblr`
6 years ago
Mike Fährmann
9a98b6769d
use extractor.request for API calls ( #130 )
...
... at least for OAuth1.0 based APIs (flickr, smugmug, tumblr)
6 years ago
Mike Fährmann
0225d90078
add exception name and traceback for OSErrors
6 years ago
Mike Fährmann
ad2cefda6b
[tumblr] in case of exception use filename as 'hash' ( #129 )
...
While a filename might not be a real 'hash', or comparable to what
tumbler usually provides, it is still better than an empty string.
At least as long as "alternatives" in format strings aren't implemented.
6 years ago
Mike Fährmann
95636418ad
[tumblr] catch exception for 'hash' extraction ( fixes #129 )
6 years ago
Mike Fährmann
40e30694f3
[pinterest] fix pin.it redirects
6 years ago
Mike Fährmann
770200888e
[gfycat] use public API endpoint
6 years ago
Mike Fährmann
b1e22e8354
release version 1.6.1
6 years ago
Mike Fährmann
5d6e219fb2
[joyreactor] update tests
6 years ago
Mike Fährmann
c59f56fe7e
[gfycat] fix extraction
...
/cajax/get/<id> doesn't work anymore
6 years ago
Mike Fährmann
ba56827f36
[newgrounds] add user-, video-, image-extractors ( #119 )
6 years ago
Mike Fährmann
15890930ea
[mangafox] fix extraction
...
use mobile version since desktop version is obfuscated
6 years ago
Mike Fährmann
a4263fb253
[luscious] add extractor for search results ( closes #127 )
6 years ago
Mike Fährmann
fb53b5dd55
fix control+c during -j and range tests
6 years ago
Mike Fährmann
a0ae156edc
[pornreactor] add tag-, user-, post-extractors ( #114 )
6 years ago
Mike Fährmann
bacbc2e7bd
[joyreactor] try to prevent JsonDecodeErrors ( #114 )
6 years ago
Mike Fährmann
503d42a1c2
[joyreactor] add tag-, user-, post-extractors ( #114 )
6 years ago
Mike Fährmann
59bb434ba5
[flickr] add ability to download all albums of a user
...
for example with 'https://www.flickr.com/photos/shona_s/albums '
6 years ago
Mike Fährmann
13cb270326
set target directory before postprocessor init ( fixes #126 )
6 years ago
Mike Fährmann
9e188f6a21
[4chan] support 4channel.org domain
6 years ago
Mike Fährmann
041bd501fc
[hentaifoundry] unescape YII_CSRF_TOKEN value
...
This fixes the POST requests to /site/filters
6 years ago
Mike Fährmann
b828473aa3
retry HTTP requests for more exception classes
6 years ago
Mike Fährmann
c2e59b9a7d
update CHANGELOG.md
...
[ci skip]
6 years ago
Mike Fährmann
d4b2b73bef
release version 1.6.0
6 years ago
Mike Fährmann
c47482b110
smaller changes, missing docs, etc.
...
- make 'netrc' extractor-specific
- rename 'downloader.enable' to 'enabled'
- document 'downloader.ytdl.format'
- consistent newlines in configuration.rst
6 years ago
Mike Fährmann
b17a5d6f3b
give downloader classes proper names
6 years ago
Mike Fährmann
3c25fa2dad
update build_testresult_db.py script
6 years ago
Mike Fährmann
7f6a0be982
adjust some tests
6 years ago
Mike Fährmann
baad7b0fa5
[twitter] unpack API responses when logged in ( closes #123 )
6 years ago
Mike Fährmann
3bdfc15be1
[pinterest] don't crash on pins without image info
6 years ago
Mike Fährmann
8ef84a6823
add option to enable/disable specific downloader modules
...
... and write URLs with no (active) downloader to unsupported-file
6 years ago
Mike Fährmann
14ee6bf611
[behance] handle external URLs with youtube-dl
6 years ago
Mike Fährmann
36425122ff
[artstation] handle external URLs with youtube-dl
6 years ago
Mike Fährmann
bd8670d925
[gfycat] extend URL pattern
6 years ago
Mike Fährmann
2fa28a2609
update default user-agent string ( closes #122 )
6 years ago
Mike Fährmann
7e2d6bcd62
[deviantart] fix original image downloads
6 years ago
Mike Fährmann
9e12e073ab
[2chan] fix extraction
6 years ago
Mike Fährmann
966a9ca3a0
update test results
6 years ago
Mike Fährmann
e26ba682a2
enforce utf-8 encoding for input files ( #120 )
6 years ago
Mike Fährmann
a36259d8f1
update setup.py
...
- add Python version check
- add classifiers
- simplify sys.exit() usage
6 years ago
Mike Fährmann
fd8ed35591
[turboimagehost] fix extraction
6 years ago