0156189468
[hentaifox] add chapter extractor ( #160 )
6 years ago
e4171d6baf
[luscious] add login capabilities ( closes #159 )
6 years ago
e53cdfd6a8
update build_supportedsites.py
6 years ago
6c71e9cf5d
[deviantart] add separate 'sta.sh' extractor ( #113 )
...
- supports multiple stashed deviations per page
- explicitly mentions sta.sh support on supportedsites.rst
6 years ago
fb53b5dd55
fix control+c during -j and range tests
6 years ago
3c25fa2dad
update build_testresult_db.py script
6 years ago
2cf3f53839
[yuki] add thread extractor ( closes #111 )
6 years ago
17611bfec0
update build_supportedsites.py script
6 years ago
c402cc4047
[hentaifoundry] add 'popular' and 'recent' extractors
...
for "Popular Pictures" and "Recent Pictures" listings
6 years ago
6ea9a78588
[wallhaven] add login capabilities
...
Being logged in is required to access NSFW wallpapers.
6 years ago
69fd61ea86
[bobx] add gallery and model extractors
6 years ago
3ecea4cf36
[hentaicafe] add chapter and manga extractors ( #101 )
6 years ago
75862715ac
[behance] add user extractor
6 years ago
e9dd2eff1d
[twitter] add extractor for media-tweet timelines ( #96 )
...
For example "https://twitter.com/PicturesEarth/media ".
They are different from normal timelines in that they do not contain
any (re)tweets from other users and feature all media the user ever
posted, including responses to other tweets.
6 years ago
63fa0b2006
[pinterest] add extractors for related pins
...
Related pins can not be accessed by adding a "#related" fragment
to the end of a Pinterest URL, for example:
- https://www.pinterest.com/pin/858146903966145189/#related
- https://www.pinterest.com/g1952849/test-/#related
There are no explicit real URLs for related pins,
using an option to enable them results in "clunky" code,
and a custom "related:<URL>" scheme doesn't feel right either.
6 years ago
84854fcad7
[myportfolio] add user and gallery extractors ( #95 )
6 years ago
a6fe2bb594
[whatisthisimnotgoodwithcomputers] remove extractor
6 years ago
55b0913412
[simplyhentai] add gallery extractor ( #89 )
6 years ago
f3483a2b7c
[smugmug] add OAuth support
6 years ago
82c50fa609
release version 1.3.5
6 years ago
16e014baaa
[smugmug] added image and album extractor
...
just some initial code that still requires a lot of work ...
TODO:
- folders
- old-style albums (which are nearly all of them ...)
- images from users
- OAuth
It could also happen that the API credentials used will become invalid
whenever my 14 day trial period ends (7 days remaining), but that
would just require users to supply their own.
6 years ago
d10579edb5
[pinterest] improve PinterestAPI code; remove OAuth mentions
...
on another note: access_tokens have been set to only allow for
10 requests per hour (from 200 yesterday)
7 years ago
4bd182c107
[pinterest] implement `oauth:pinterest` ( #83 )
...
Pinterest access tokens are rate limited at 200 requests per
hour (or maybe per 2 or 3 hours?) so having just one access token
for all users isn't going to work in the long run.
7 years ago
7b562907c3
[nijie] add favorites extractor
...
adds support for 'https://nijie.info/user_like_illust_view.php?id= ...'
7 years ago
299ae24996
[test] add a few downloader tests
7 years ago
dd314279fb
[test] add unit tests for extractor module functions
7 years ago
d75dc71394
fix travis tests
7 years ago
8ef790de12
update .travis.yml
...
- restrict builds to master branch and release tags
- implement 'core' and 'results' test categories
7 years ago
7121eeae8b
check supportedsites.rst in release script
7 years ago
1400868f53
[mangadex] general improvements
...
- support >100 chapter entries per manga
- custom archive ID format
- detect non-existing chapters
7 years ago
40d35c87bc
[paheal] add tag- and post-extractors ( closes #69 )
7 years ago
35e09869d1
[mangapark] fix image URLs and use HTTPS
7 years ago
29d75fc3fa
[tumblr] add support for OAuth authentication ( #65 )
7 years ago
b33efc99a4
[idolcomplex] add support for idol.sankakucomplex.com
7 years ago
5b094328b5
[puremashiro] add chapter- and manga-extractor ( closes #66 )
...
Also adds support for region subtags in language codes (e.g. en-us)
7 years ago
fc7d165c97
[deviantart] add support for OAuth2 authentication
...
Some user galleries [*] require you to be either logged in or
authenticated via OAuth2 to access their deviations.
[*] e.g. https://polinaegorussia.deviantart.com/gallery/
--------------
known issue:
A deviantart 'refresh_token' can only be used once and gets updated
whenever it is used to request a new 'access_token', so storing its
initial value in a config file and reusing it again and again is not
possible.
7 years ago
0a9a07a6e1
[slideshare] improve metadata; flake8
...
- added 'views' and 'published' keywords
- fixed longer titles and descriptions
7 years ago
2c1adda784
update release.sh script
...
- update CHANGELOG on new releases
- change issue references to actual links
- replace "Unreleased" with new version and date
- fix filenames of old Windows executables
[no ci]
7 years ago
2d0cfb33e1
[xvideos] add user profile extractor ( #45 )
7 years ago
035ef655f1
[imagefap] update unit tests
...
old gallery/image has been deleted
7 years ago
6af921a952
[sankaku] rewrite/improve ( fixes #44 )
...
- add wait-time between HTTP requests similar to exhentai
- add 'wait-min' and 'wait-max' options
- increase retry-count for HTTP requests to 10
- implement user authentication (non-authenticated users can only view
images up to page 25)
- implement 'skip()' functionality (only works up to page 50)
- implement image-retrieval for pages >= 51
- fix issue with multiple tags
7 years ago
0386503c80
fix (sub)category-transfer for DownloadJob instances ( #41 )
...
... and extend "parent" parameters to TestJob- and DataJob-classes
as well.
7 years ago
cebf800a7f
[foolfuuka] add support for more sites ( #18 )
...
- https://arch.b4k.co
- https://archive.whatisthisimnotgoodwithcomputers.com
- https://archive.yeet.net
Notes:
- The name "whatisthisimnotgoodwithcomputers" is way too long ...
- archive.yeet.net is out of date and also blocked by 4chan servers
- newest threads are 2 weeks old
- using "https://archive.yeet.net " as Referer header results in
"403 Forbidden" when accessing 4chan
7 years ago
18e6ed1c7e
[booru] add extractors for "Popular" images
7 years ago
d7cb3c668a
update supportedsites.rst
7 years ago
74a2b5af06
update supportedsites.rst
7 years ago
1dac76fd1c
update extractor docstrings
7 years ago
92a11528d1
smaller changes
7 years ago
2993206c4b
smaller fixes and "security" measures
...
- move the OAuthSession class into util.py
- block special extractors for reddit and recursive
- ignore 'only matching' tests for testresults script
7 years ago
fb1904dd59
add 'Authentication' column to supportedsites.rst
7 years ago
c921b4f32a
code cleanup and fixing tests
7 years ago
659c65dbb0
[flickr] add image extractor
7 years ago
f79320e35b
fix tests
7 years ago
398506da45
update release script
7 years ago
1e416e5227
update README
7 years ago
4332694492
add simple imagehosts to list of supported sites
8 years ago
9f32cf1f4e
improve supportedsites.rst and build script
8 years ago
385285932a
add script to collect test results in JSON format
8 years ago
e9b445a0f8
update release script
8 years ago
2b9cf4fd83
add script to build and release new versions
8 years ago
ed94d9b92d
fix/improve various things
8 years ago
9538a873cb
move create_test_data script
8 years ago
659577ae54
add a script to automatically build a list of supported sites
8 years ago
Mike Fährmann