Mike Fährmann
fa33f13453
[mastodon] update
...
- inherit from BaseExtractor
- remove custom generate_extractors() and config()
- improve layout of MastodonAPI internals
4 years ago
Mike Fährmann
231bcad614
[shopify] use BaseExtractor
4 years ago
Mike Fährmann
2de8ebc098
[moebooru] use BaseExtractor
4 years ago
Mike Fährmann
0978c1e184
[booru] use BaseExtractor
4 years ago
Mike Fährmann
993856b866
[foolslide] use BaseExtractor
4 years ago
Mike Fährmann
671a95cae5
[foolfuuka] use BaseExtractor
4 years ago
Mike Fährmann
745a114c61
[common] implement BaseExtractor class
...
Should be used when the same extractor logic applies to different
instances/domains of several sites, e.g. FoolFuuka, Shopify, etc.
This will replace the functionality of 'generate_extractors()' in
a more efficient way, by condensing everything into 1 class and not
dynamically generating an extractor class for each instance.
4 years ago
Mike Fährmann
b549c53b36
add long option for '-G'
4 years ago
Mike Fährmann
ebf417f31f
remove support for deprecated options
...
- instagram.highlights
- metadata.bypost
- exec.final
4 years ago
Mike Fährmann
477ed010c1
release version 1.16.4
4 years ago
Mike Fährmann
1d13e48512
[unsplash] implement 'skip()'
4 years ago
Mike Fährmann
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst
4 years ago
Mike Fährmann
0eea424a52
update supportedsites.rst
4 years ago
Mike Fährmann
6cdbfb79e9
[photovogue] update ( #1253 )
4 years ago
Federico Ravasio
25297815bc
[photovogue] added portfolio extractor ( #1253 )
4 years ago
Mike Fährmann
0265fbda61
[mangakakalot] fix extraction
4 years ago
Mike Fährmann
7a096c443f
[unsplash] add 'format' option ( #1197 )
4 years ago
Mike Fährmann
3188ac16d1
[unsplash] add 'collection' extractor ( #1197 )
4 years ago
Mike Fährmann
247cc73446
[derpibooru] update 'date' parsing
4 years ago
Mike Fährmann
193dca2ce1
update extractor test results
4 years ago
Mike Fährmann
89ea1384fc
[unsplash] fix typo
4 years ago
Mike Fährmann
e5e591b848
[vipr] simplify and add test ( #1258 )
4 years ago
v-delta
e707e060cb
[vipr] add image extractor ( #1258 )
...
* [vipr] add image extractor
Adds support for images hosted on https://vipr.im
* Fix codestyle issues
4 years ago
Mike Fährmann
95e5911895
[twitter] match '/i/user/ID' URLs
4 years ago
Mike Fährmann
069b113cbf
[twitter] improve and fix retry after hitting rate limit
...
- replace recursive call with infinite loop
- fix function arguments for recursive call
4 years ago
Mike Fährmann
89a2bcbb2d
[furaffinity] add 'descriptions' option ( #1231 )
4 years ago
Mike Fährmann
36f281330a
[newgrounds] fix flash file extraction ( closes #1257 )
...
… and add a 'flash' option to choose between flash and video formats.
4 years ago
Mike Fährmann
534194bf92
[unsplash] add extractors ( #1197 )
...
for
- single photos (/photos/ID)
- user profiles (/@USER)
- user likes (/@USER/likes)
- search results (/s/photos/SEARCH)
4 years ago
Mike Fährmann
1fc16cb8c5
[instagram] fix regex for '/saved' URLs ( fixes #1251 )
...
The URL pattern erroneously had two '([^/?#]+)' capture groups,
which would split any username into 'usernam' for the first group
and 'e' for the ignored second group.
4 years ago
Mike Fährmann
c008cb5100
[pixiv] add 'related' option ( #1237 )
4 years ago
Mike Fährmann
e9a75e27d9
[foolfuuka] stop search when results are exhausted ( #1174 )
4 years ago
Mike Fährmann
b0cf968115
[mangadex] update API URLs
...
https://mangadex.org/thread/351011/9/#post_4238014
4 years ago
Mike Fährmann
a6414c31d6
[kemonoparty] simplify ( #1216 )
...
Use metadata from API responses as is and
don't try to detect duplicated by their original filename.
4 years ago
Mike Fährmann
01b9ccd4de
[derpibooru] use the "Everything" filter by default ( #1243 )
...
when neither 'api-key' nor 'filter' are set
4 years ago
Mike Fährmann
91308140ec
make 'generate_token()' compatible with Python 3.4
4 years ago
Mike Fährmann
1fdecfa269
[kemonoparty] use API endpoints ( #1216 )
4 years ago
Mike Fährmann
318876e4dd
[nozomi] add 'num' enumeration index ( closes #1239 )
4 years ago
Mike Fährmann
2da9068ea8
[sankaku] simplify login process
4 years ago
Mike Fährmann
e07dfc4fe5
[kemonoparty] add 'user' and 'post' extractors ( #1216 )
4 years ago
Mike Fährmann
780b6adb91
rename 'generate_csrf_token()' to just 'generate_token()'
...
and add a 'size' argument
4 years ago
Mike Fährmann
f277e48c77
release version 1.16.3
4 years ago
Mike Fährmann
79501a356f
fix crash when 'path-restrict' is an object/dict
...
This basically reverts commit 5818c928
(#1234 )
4 years ago
Mike Fährmann
0fdaea00a3
[postprocessor:metadata] sanitize filenames
4 years ago
Mike Fährmann
32fcc61b84
release version 1.16.2
4 years ago
Mike Fährmann
02bc59d75c
[hentainexus] fix extraction ( fixes #1234 )
...
hentainexus is now hosting its images on wordpress, or at least it is
using wordpress' servers as cache:
https://i2.wp.com/images.hentainexus.com/gallery/2199754b23c191deb330c99c9bb43341/9576/002.png?filter=null
4 years ago
Mike Fährmann
5d4494b15f
add "ascii" as a special 'path-restrict' value
4 years ago
Mike Fährmann
5818c928c4
refactor 'path-restrict' parsing
4 years ago
Mike Fährmann
aac00a2024
add 'd' conversion for format strings
...
to convert a timestamp to a formattable 'datetime' object.
For example '{created_at!d:%Y-%m-%d}'
transforms the timestamp in 'created_at' into a 'datetime' object
and then formats its content using '%Y-%m-%d' as template.
1262304000 -> datetime(2010, 1, 1) -> "2010-01-01"
4 years ago
Mike Fährmann
20bd9cd296
[wikiart] add extractor for single paintings ( closes #1233 )
...
There is no API endpoint for single paintings from what I can tell,
so this uses the site's search.
4 years ago
Mike Fährmann
e2d4ca4955
[deviantart] improve '--range' for favorites ( closes #1226 )
4 years ago