5f05543f23
[reddit] support filtering by timestamp ( #15 )
...
- Added the 'extractor.reddit.date-min' and '….date-max'
config options. These values should be UTC timestamps.
- All submissions not posted in date-min <= T <= date-max
will be ignored.
- Fixed the limit parameter for submission comments by setting
it to its apparent max value (500).
7 years ago
4e80e0c884
[flickr] add user extractor ( #16 )
7 years ago
b81d068a6d
[flickr] add favorites extractor ( #16 )
7 years ago
c921b4f32a
code cleanup and fixing tests
7 years ago
dfe82526ee
update README
7 years ago
72f1c6f87a
[flickr] add support for flic.kr/p/... URLs
...
Example:
https://flic.kr/p/FPVo9U
7 years ago
93e5d8cba3
[flickr] add album extractor
7 years ago
659c65dbb0
[flickr] add image extractor
7 years ago
b6fffa9e26
[directlink] update filename format and metadata
7 years ago
c184e47ee3
put common directory- and filename formats in base classes
7 years ago
bce51e90a5
[reddit] support sorting options and sub-options ( #15 )
...
Example:
https://www.reddit.com/r/ <subreddit>/top/?sort=top&t=month
(the 'sort=top' parameter is irrelevant and can be omitted)
7 years ago
5f45ce2930
[gfycat] add "format" config key to select a video format
...
Possible values:
- one of "mp4" (default), "webm", "gif", "webp", "mjpg"
If the selected format is not available, "mp4", "webm" and "gif"
(in that order) will be tried instead, until an available format
is found.
7 years ago
011659ced5
[imgur] add "mp4" config key to decide between GIF and MP4
...
possible values:
- false : always use GIF
- true : use MP4 if "prefer_video" flag is set,
GIF otherwise (default)
- "always": always use MP4
7 years ago
48ccee2505
[gfycat] add image extractor
7 years ago
25bcdc8aa9
add `--write-unsupported` option ( #15 )
7 years ago
bf452a8516
[imgur] choose .mp4 over .gif if available
7 years ago
f79320e35b
fix tests
7 years ago
67791e1b36
[imgur] improve and add image extractor
7 years ago
99b72130ee
[reddit] enable recursion ( #15 )
...
reddit extractors now recursively visit other submissions/posts
linked to in the initial set of submissions.
This behaviour can be configured via the 'extractor.reddit.recursion'
key in the configuration file or by `-o recursion=<value>`.
Example:
{"extractor": {
"reddit": {
"recursion": <value>
}}}
Possible values:
* -1 - infinite recursion (don't do this)
* 0 - recursion is disabled (default)
* 1 and higher - maximum recursion level
7 years ago
ae686c4c08
run queue items immediately
7 years ago
691c4dd709
support direct image links
7 years ago
d2dceb35b7
implement context-manager to blacklist extractors
7 years ago
30eef527d8
update output logic on error
...
[ci skip]
7 years ago
e425243b1e
[reddit] some small fixes
...
- filter or complete some URLs
- remove the 'nofollow:' scheme before printing URLs
- (#15 )
7 years ago
a22892f494
[reddit] add subreddit- and submission-extractor
...
- these extractors scan submissions and their comments for
(external) URLs and defer them to other extractors
- (#15 )
7 years ago
398506da45
update release script
7 years ago
8db3a2fea8
release version 0.8.4
7 years ago
832a4a8ee9
[fallenangels] add manga extractor
7 years ago
f226417420
simplify code by using a MangaExtractor base class
7 years ago
2974d782a3
[yomanga] remove module
...
site has been shut down
7 years ago
cbb4323f66
add setup.cfg to configure flake8
7 years ago
232fe2dd08
improve the test extractor
7 years ago
b0131ea402
[fallenangels] support this site's Vietnamese version
...
- https://truyen.fascans.com/
7 years ago
a90c6acc9c
code cleanup + fixes
7 years ago
4c88c0d496
rework the output format for --list-keywords
7 years ago
b6b214f7e9
[deviantart] fix headers for custom-style journals
...
example: http://shimoda7.deviantart.com/journal/Temporary-absence-231936282
7 years ago
e9a2738257
[deviantart] support images on top of journal entries
...
example: http://raxnae.deviantart.com/art/Kami-s-Journal-679482236
7 years ago
92597f46d4
[deviantart] add title to journals
7 years ago
107d29ad8a
improve handling of text:... URLs
...
- don't require // after the colon
- open output files in text mode
7 years ago
677c8ced11
[deviantart] add "journal" extractor
...
(#14 )
7 years ago
e5f79ae839
[deviantart] add support for all media types
...
- this includes
- images
- videos
- flash-animations
- journals
- also renamed some of the extractors
- User -> Gallery
- Image -> Deviation
7 years ago
ab4a38cb10
update README
7 years ago
1e416e5227
update README
7 years ago
9f1c83297f
[pinterest] allow URLs with any TLD
7 years ago
b3b92ac243
[deviantart] support "All" favorites and add "mature" option
...
- since there is apparently no actual way to get the "All" favorites
listing via API, corresponding URLs (.../favourites/?catpath=/) will
be handled by yielding all deviations from all favorite collections of
that user
- the "mature" config key works on a per extractor basis (like "username"
or "password"). values can be the strings "true" or "false", or the
booleans true or false.
- (#14 )
7 years ago
7376ad7f3d
[deviantart] turn the "Mature Content Filter" off
...
(#14 )
7 years ago
ef90a2de2f
implement the "exit" option for the "skip" config-key
7 years ago
cfbf79d788
[pixiv] fix login
7 years ago
85a46ed700
[booru] fix issue with multiple tags
7 years ago
fc9223c072
add '--abort-on-skip' option and ability to control skip behavior
...
the 'skip' config option controls skipping behavior:
true - skip download if file already exist (default)
false - download and overwrite files even if it exists
"abort" - abort extractor run if a download would be skipped
(same as '--abort-on-skip')
7 years ago
Mike Fährmann