92027f67f9
use consistent names for URL constants
...
root := <scheme>://<host>
base_url := <root>/<common path>
7 years ago
6f30cf4c64
change keyword names to valid Python identifiers
...
This commit mostly replaces all minus-signs ('-') in keyword names with
underscores ('_') to allow them to be used in filter-expressions. For
example 'gallery-id' got renamed to 'gallery_id'.
(It is theoretically possible to access any variable, regardless of its
name, with 'locals()["NAME"]', but that seems a bit too convoluted if
just 'NAME' could be enough)
7 years ago
58e95a7487
share extractor and downloader sessions
...
There was never any "good" reason for the strict separation
between extractors and downloaders. This change allows for
reduced resource usage (probably unnoticeable) and less lines
of code at the "cost" of tighter coupling.
7 years ago
c184e47ee3
put common directory- and filename formats in base classes
7 years ago
107d29ad8a
improve handling of text:... URLs
...
- don't require // after the colon
- open output files in text mode
7 years ago
e5f79ae839
[deviantart] add support for all media types
...
- this includes
- images
- videos
- flash-animations
- journals
- also renamed some of the extractors
- User -> Gallery
- Image -> Deviation
7 years ago
9f1c83297f
[pinterest] allow URLs with any TLD
7 years ago
13dc5d72bc
update some extractors to use https
8 years ago
94e10f249a
code adjustments according to pep8 nr2
8 years ago
d402e644bf
update tests
8 years ago
68fe58ee72
[imgchili] set encoding
8 years ago
19c2d4ff6f
remove explicit (sub)category keywords
8 years ago
888a988725
[imgchili] workaround for long filenames
8 years ago
808cf69556
update a few tests
8 years ago
a2c5b1e07d
[imgchili] rewrite + single-image extractor
8 years ago
4d56b76aa8
update all other extractors
9 years ago
539faa0322
remove SequentialExtractor class
9 years ago
3c13548f29
rewrite extractors to use config-module
9 years ago
42b8e81a68
rewrite extractors to use text-module
9 years ago
ffec41f352
[imgchili] update to new extractor interface
10 years ago
a66a5099f8
added extractor 'imgchili'
10 years ago
Mike Fährmann