fdfdc1b614
[kissgoddess] add 'gallery' and 'model' extractors
...
(closes #1052 , #2304 )
3 years ago
c8414c9d95
build Linux executable in its own virtualenv
3 years ago
b17e2dcf93
[wallpapercave] add extractor for images ( #2205 )
3 years ago
cf3b51f8aa
fix building supportedsites.md on Python 3.4 and 3.5
...
dicts didn't maintain insertion order back then
3 years ago
563bd0ecf4
[danbooru] inherit from BaseExtractor
...
- merge danbooru and e621 code
- support booru.allthefallen.moe (closes #2283 )
- remove support for old e621 tag search URLs
3 years ago
4e4cb40663
do not sort BaseExtractor instances by name
3 years ago
b4f8e15a1f
allow BaseExtractors to use the domain pf the matched URL
3 years ago
cc7dce5755
[sexcom] add 'pins' extractor ( closes #2265 )
3 years ago
fa7d92f7a9
add docs for 'extractor.generic.enabled'
3 years ago
22b0433985
[fanbox] support pixiv redirects ( closes #2122 )
3 years ago
882c614281
add album extractor for lolisafe/chibisafe instances
...
- support bunkr.is (closes #2038 )
- support zz.ht (closes #2105 )
3 years ago
299bd2f1f5
[rule34us] add 'tag' and 'post' extractors ( #1527 )
3 years ago
f4e3cee6ac
use yt-dlp by default ( #1850 , #2028 )
3 years ago
addb72e1bb
[reactor] support thatpervert.com ( closes #2029 )
3 years ago
d8d9502e1e
[reactor] inherit from BaseExtractor
3 years ago
bcbf9bcf36
[kemonoparty] split 'discord' extractor ( #1940 )
...
in 'server' and 'channel'
3 years ago
fe6ce5495a
[kemonoparty] add 'discord' extractor ( #1827 , #1940 )
3 years ago
f2d6b3e6b4
run tests without using 'nose'
...
run_tests.sh -> run_tests.py
3 years ago
e33125ad39
[pixiv] add 'sketch' extractor ( #1497 )
3 years ago
373d3e1c57
[seisoparty] implement login with username & password ( #1906 )
3 years ago
74145467dd
move 'util.Formatter' into its own 'formatter' module
3 years ago
e4684c5cb9
[desktopography] simplify ( #1740 )
3 years ago
7b05600056
[pinterest] only mention cookies for authentication ( #1856 )
...
regular login is broken due to CAPTCHA
3 years ago
bd845303ad
implement a way to shorten filenames with east-asian characters
...
(#1377 )
Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower
algorithm that also considers characters with a width > 1.
3 years ago
0fd959a2a7
[twitter] support '/with_replies' URLs ( closes #1833 )
3 years ago
4ec11af6a4
[kemonoparty] implement login with username & password ( #1824 )
3 years ago
51eb50749f
[foolslide] remove entry for kobato.hologfx.com
3 years ago
da7297c0b9
[comicvine] add extractor ( closes #1712 )
3 years ago
e4788fa663
[bbc] add 'gallery' and 'programme' extractors ( closes #1706 )
3 years ago
74b457b2b5
remove unused entries
3 years ago
36ac2197db
[ytdl] add extractor for sites supported by youtube-dl
...
(#1680 , #878 )
Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
3 years ago
8ecca3af58
[pixiv] add extractor for 'pixivision' articles ( #1672 )
3 years ago
267bbf5996
[mangasee] add 'chapter' and 'manga' extractors
3 years ago
f74cf52e2b
[seisoparty] add 'user' and 'post' extractors ( #1635 )
3 years ago
1197ee2c20
[mangadex] add extractor for a user's followed feed ( #1535 )
3 years ago
07c8adbd8b
[mangadex] implement login with username & password ( #1535 )
3 years ago
407627ec86
[foolfuuka] support 'archive.wakarimasen.moe' ( closes #1595 )
3 years ago
52052a0e1a
[manganelo] update domain to 'manganato.com'
3 years ago
1eabfa5c7a
[pillowfort] implement login with username & password ( #846 )
3 years ago
559462789d
add some tests for job.py
3 years ago
c6c4a73f87
update fanbox entry in supportedsites.md
3 years ago
e47952ac14
add extractors for fantia and fanbox ( #1459 )
...
* add extractors for fantia and fanbox
* appease linter
* make docstrings unique
* [fantia] refactor post extraction
* [fantia] capitalize
* [fantia] improve regex pattern
* code style
* capitalize
* [fanbox] use BASE_PATTERN for url regexes
* [fanbox] refactor metadata and post extraction
* [fanbox] improve url base pattern
* [fanbox] accept creator page links ending with /posts
* [fanbox] more tests
* [fantia] improved pagination
* [fanbox] misc. code logic improvements
* [fantia] finish restructuring pagination code
* [fanbox] avoid making a request for each individual post when processing a creator page
* [fanbox] support embedded videos
* [fanbox] fix errors
* [fanbox] document extractor.fanbox.videos
* [fanbox] handle "article" and "entry" post types, all embeds
* [fanbox] fix downloading of embedded fanbox posts
3 years ago
77a9cc6fd6
update supportedsites.md entry for Instagram
3 years ago
334d690687
[hentaicosplays] Add extractor ( #1473 )
3 years ago
086925e685
[shopify] support omgmiamiswimwear.com ( closes #1280 )
3 years ago
78d7ee3ef4
[yuki] remove module for yuki.la
3 years ago
d5aad999dc
[tapas] implement login with username & password ( #692 )
4 years ago
62cfee4d28
[vk] initial support for albums ( #474 )
4 years ago
91c2e15da9
[deviantart] add support for posts from watched users ( #794 )
4 years ago
69ca4e29f1
[deviantart] add 'watch' extractor ( #794 )
4 years ago
c485d0a956
[philomena] add generalized extractors for philomena sites
...
(closes #1379 )
4 years ago
72fe9ac0f3
[gelbooru_v01] support some more boorus by default
...
- https://drawfriends.booru.org/
- https://vidyart.booru.org/
- https://tlb.booru.org/
4 years ago
ec98b2c56f
categorize sites in supportedsites.md by basecategory
4 years ago
a67e002f40
update docs/supportedsites
...
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
4 years ago
4be27ff0fe
[nozomi] support '/index-N.html' URLs ( closes #1365 )
...
and '/index-Popular-N.html'
4 years ago
665499924d
Support naver webtoon ( #1331 )
...
* Support naver webtoon (WIP)
* Apply patch
* Change filename format
* Fill test results
* Fill test result
4 years ago
a9119da4d4
support `tumblrgallery.xyz` ( #1298 )
...
* support `tumblrgallery.xyz`
* fix format issues
* Refactor and add post and search page support
* Fix warnings
* Few improvments
* Better file names
* Fix linting errors
* move id closer to the begining of the file name
Co-authored-by: topozorra <none>
4 years ago
e165e6c265
[wallhaven] add 'collections' extractor ( #1351 )
4 years ago
1a38fae785
add option to use different youtube-dl modules ( fixes #1330 )
...
by setting the 'downloader.ytdl.module' value. For example
{
"downloader": {
"ytdl": {
"module": "yt_dlp"
}
}
}
or '-o module=yt_dlp'
4 years ago
e39aea42cd
fix supportedsites.py for modules without docstring
...
(fixes #1332 )
4 years ago
03b219db9d
fix supportedsites.py
4 years ago
8974f0361c
[pixiv] update ( #1304 )
...
- remove login with username & password
- require a refresh token
- add 'oauth:pixiv' functionality
See also:
- https://github.com/upbit/pixivpy/issues/158
- https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362
4 years ago
ae530f6365
[erome] add extractors for albums, users, searches ( closes #409 )
4 years ago
e1bdd2ab67
add a 'generated by …' comment to supportedsites.rst
4 years ago
0eea424a52
update supportedsites.rst
4 years ago
fa8ee6eac4
[derpibooru] add search and gallery extractors ( #862 )
4 years ago
b0beed7a06
[sankaku] add support for book searches ( closes #1204 )
4 years ago
6cdbab07b5
[pinterest] add support for getting all boards of a user
...
(#1205 )
4 years ago
df9e40ab35
small updates to release.sh
...
- use git push --atomic
- update VM name
- rename (git|pypi)-upload
4 years ago
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
de0c57886d
[twitter] add 'list-members' extractor ( closes #1096 )
4 years ago
05d7009cc6
rename 'Authentication' entries in supportedsites.rst
...
- change 'Optional' to 'Supported'
- use 'OAuth' and 'Cookies' in their own
- add link to weasyl API key option
4 years ago
3ec60e894a
[weasyl] api-key authentication ( #1057 )
...
* [weasyl] support api keys
* [weasyl] document api-key authentication
* [weasyl] usernames can contain ~
4 years ago
b9bdd2c564
[hentaifoundry] add support for stories ( closes #734 )
4 years ago
117582d798
use definition lists instead of tables in docs/configuration.rst
...
and strip some clutter from generated man pages
4 years ago
e9cc719497
[weasyl] update and simplify
...
- simplify 'pattern' regexps
- parse 'posted_at' as 'date'
- use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)
4 years ago
c43b3894be
[myhentaigallery] update and fix extraction ( #1001 )
...
- extract more metadata
- match "/show/" URLs
- complete test results
- fix missing images for lines starting with " <img"
- fix missing comma in supportedsites.py
4 years ago
05b9ac8d37
[myhentaigallery] add extractor ( #1001 )
...
* adds support for myhentaigallery
* fixes linting issues in myhentaigallery extractor
4 years ago
0e941553ec
[aryion] Add username/password support ( #960 )
...
* Add username/password support to aryion extractor
* Update docs to match
* Fix code style
4 years ago
901a897e6f
[inkbunny] mention login support
4 years ago
d5fcffcced
[subscribestar] add login capabilities ( #852 )
4 years ago
df7217c36d
update supportedsites.py ( #889 , #893 )
...
- mention optional auth access for more sites
- link to OAuth and Cookies sections in README
4 years ago
7dfdcc3fbf
[mangakakalot] Added extractors for MangaKakalot ( #876 )
4 years ago
74494b43d3
let zsh completion immediately suggest cmdline options
...
instead of expecting an URL and trying to complete it.
4 years ago
d0cd86e0d5
add zsh completion script ( #150 )
4 years ago
e62ebb4643
update CHANGELOG before building sdist and wheel packages
4 years ago
0f459f340b
[instagram] fix and re-enable login with username&password
...
This reverts commit 3e0848a482#756 , #771 , #797 , #803 )
https://github.com/althonos/InsaLooter/issues/287#issuecomment-630456522
4 years ago
3e0848a482
[instagram] disable login with username&password ( #756 )
4 years ago
39cd389679
[webtoons] Add a new extractor for webtoons.com ( #761 )
...
The webtoons extractor can extract episode and entire comic (all
episodes) from webtoons.com.
All the logic of the extractors should be trivial except for a couple
of kludges needed:
- `ageGatePass' cookie is always set to avoid possible redirect and stop of
extraction, especially in the comic extractor
- The image URLs returned by the episode extractor could not be fetched
directly and the `Referer:' HTTP header needs to be passed to fetch them
Close #593 .
4 years ago
7b5711ee04
[imagechest] Add new extractor for ImageChest ( #750 )
...
* [imagechest] Add new extractor for ImageChest
* [imagechest] Fix flake8 compliance issues
4 years ago
f557cac074
[redgifs] add image extractor ( #724 )
4 years ago
b47cfc5ac9
[speakerdeck] Add a new extractor for speakerdeck.com ( #726 )
4 years ago
6143050980
[aryion] add gallery and post extractors ( #390 , #673 )
5 years ago
2587296deb
[mastodon] add access tokens for mastodon.social and baraag.net
...
(closes #665 )
5 years ago
c8db2a87e9
fix create_test_data.py script
5 years ago
88ebbadc58
remove dashes from subcategory names in supportedsites.rst
5 years ago
90d15e3682
[instagram] use 'itertools.chain()'
5 years ago
5b676ea59d
[e621] document username & password support ( #640 )
5 years ago
Mike Fährmann