mirror_maker
/
gallery-dl
mirror of https://github.com/mikf/gallery-dl.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

update docs/supportedsites

Browse Source 
- use Markdown with inline HTML instead of reStructuredText
- move file from docs/supportedsites.rst to docs/supportedsites.md
- update Makefile, README, etc
pull/1405/head
Mike Fährmann 4 years ago
parent df94182e11
commit a67e002f40
No known key found for this signature in database
GPG Key ID: 5680CA389D365A88
6 changed files with 1019 additions and 244 deletions
Show Stats Download Patch File Download Diff File

10
Makefile
Unescape View File

@ -6,7 +6,7 @@ SHAREDIR ?= $(PREFIX)/share
PYTHON ?= /usr/bin/env python3
all: man completion docs/supportedsites.rst
all: man completion supportedsites
clean:
$(RM) -r build/
@ -15,7 +15,7 @@ clean:
install: man completion
$(PYTHON) setup.py install
release: man completion docs/supportedsites.rst
release: man completion supportedsites
scripts/release.sh
test:
@ -28,9 +28,11 @@ completion: data/completion/gallery-dl data/completion/_gallery-dl
man: data/man/gallery-dl.1 data/man/gallery-dl.conf.5
.PHONY: all clean install release test executable completion man
supportedsites: docs/supportedsites.md
docs/supportedsites.rst: gallery_dl/*/*.py scripts/supportedsites.py
.PHONY: all clean install release test executable completion man supportedsites
docs/supportedsites.md: gallery_dl/*/*.py scripts/supportedsites.py
$(PYTHON) scripts/supportedsites.py
data/man/gallery-dl.1: gallery_dl/option.py gallery_dl/version.py scripts/man.py

2
README.rst
Unescape View File

@ -317,7 +317,7 @@ To authenticate with a ``mastodon`` instance, run *gallery-dl* with
.. _gallery-dl.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl.conf
.. _gallery-dl-example.conf: https://github.com/mikf/gallery-dl/blob/master/docs/gallery-dl-example.conf
.. _configuration.rst: https://github.com/mikf/gallery-dl/blob/master/docs/configuration.rst
.. _Supported Sites: https://github.com/mikf/gallery-dl/blob/master/docs/supportedsites.rst
.. _Supported Sites: https://github.com/mikf/gallery-dl/blob/master/docs/supportedsites.md
.. _Python: https://www.python.org/downloads/
.. _PyPI: https://pypi.org/

965
docs/supportedsites.md
Unescape View File

@ -0,0 +1,965 @@
# Supported Sites
<!-- auto-generated by scripts/supportedsites.py -->
Consider all sites to be NSFW unless otherwise known.
<table>
<thead valign="bottom">
<tr>
<th>Site</th>
<th>URL</th>
<th>Capabilities</th>
<th>Authentication</th>
</tr>
</thead>
<tbody valign="top">
<tr>
<td>35PHOTO</td>
<td>https://35photo.pro/</td>
<td>Genres, individual Images, Tag Searches, User Profiles</td>
<td></td>
</tr>
<tr>
<td>3dbooru</td>
<td>http://behoimi.org/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>4chan</td>
<td>https://www.4chan.org/</td>
<td>Boards, Threads</td>
<td></td>
</tr>
<tr>
<td>4plebs</td>
<td>https://archive.4plebs.org/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>500px</td>
<td>https://500px.com/</td>
<td>Galleries, individual Images, User Profiles</td>
<td></td>
</tr>
<tr>
<td>8kun</td>
<td>https://8kun.top/</td>
<td>Boards, Threads</td>
<td></td>
</tr>
<tr>
<td>8muses</td>
<td>https://comics.8muses.com/</td>
<td>Albums</td>
<td></td>
</tr>
<tr>
<td>Acidimg</td>
<td>https://acidimg.cc/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Adobe Portfolio</td>
<td>https://www.myportfolio.com/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>Adult Empire</td>
<td>https://www.adultempire.com/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>Allgirlbooru</td>
<td>https://allgirl.booru.org/</td>
<td>Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>arch.b4k.co</td>
<td>https://arch.b4k.co/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Archive of Sins</td>
<td>https://archiveofsins.com/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Archived.Moe</td>
<td>https://archived.moe/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>ArtStation</td>
<td>https://www.artstation.com/</td>
<td>Albums, Artwork Listings, Challenges, individual Images, Likes, Search Results, User Profiles</td>
<td></td>
</tr>
<tr>
<td>baraag</td>
<td>https://baraag.net/</td>
<td>Images from Statuses, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Behance</td>
<td>https://www.behance.net/</td>
<td>Collections, Galleries, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Blogger</td>
<td>https://www.blogger.com/</td>
<td>Blogs, Posts, Search Results</td>
<td></td>
</tr>
<tr>
<td>Cyberdrop</td>
<td>https://cyberdrop.me/</td>
<td>Albums</td>
<td></td>
</tr>
<tr>
<td>Danbooru</td>
<td>https://danbooru.donmai.us/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td>Supported</td>
</tr>
<tr>
<td>Derpibooru</td>
<td>https://derpibooru.org/</td>
<td>Galleries, Posts, Search Results</td>
<td><a href="configuration.rst#extractorderpibooruapi-key">API Key</a></td>
</tr>
<tr>
<td>Desuarchive</td>
<td>https://desuarchive.org/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>DeviantArt</td>
<td>https://www.deviantart.com/</td>
<td>Collections, Deviations, Favorites, Folders, Galleries, Journals, Popular Images, Scraps, Sta.sh, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Doki Reader</td>
<td>https://kobato.hologfx.com/reader/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Dynasty Reader</td>
<td>https://dynasty-scans.com/</td>
<td>Chapters, individual Images, Search Results</td>
<td></td>
</tr>
<tr>
<td>E-Hentai</td>
<td>https://e-hentai.org/</td>
<td>Favorites, Galleries, Search Results</td>
<td>Supported</td>
</tr>
<tr>
<td>e621</td>
<td>https://e621.net/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td>Supported</td>
</tr>
<tr>
<td>Eka's Portal</td>
<td>https://aryion.com/</td>
<td>Galleries, Posts</td>
<td>Supported</td>
</tr>
<tr>
<td>EroMe</td>
<td>https://www.erome.com/</td>
<td>Albums, Search Results, User Profiles</td>
<td></td>
</tr>
<tr>
<td>ExHentai</td>
<td>https://exhentai.org/</td>
<td>Favorites, Galleries, Search Results</td>
<td>Supported</td>
</tr>
<tr>
<td>Fallen Angels Scans</td>
<td>https://www.fascans.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Fashion Nova</td>
<td>https://www.fashionnova.com/</td>
<td>Collections, Products</td>
<td></td>
</tr>
<tr>
<td>Fireden</td>
<td>https://boards.fireden.net/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Flickr</td>
<td>https://www.flickr.com/</td>
<td>Albums, Favorites, Galleries, Groups, individual Images, Search Results, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Fur Affinity</td>
<td>https://www.furaffinity.net/</td>
<td>Favorites, Galleries, Posts, Scraps, Search Results, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#cookies">Cookies</a></td>
</tr>
<tr>
<td>Fuskator</td>
<td>https://fuskator.com/</td>
<td>Galleries, Search Results</td>
<td></td>
</tr>
<tr>
<td>Futaba Channel</td>
<td>https://www.2chan.net/</td>
<td>Threads</td>
<td></td>
</tr>
<tr>
<td>Gelbooru</td>
<td>https://gelbooru.com/</td>
<td>Pools, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Gfycat</td>
<td>https://gfycat.com/</td>
<td>individual Images, Search Results, User Profiles</td>
<td></td>
</tr>
<tr>
<td>HBrowse</td>
<td>https://www.hbrowse.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Hentai Cafe</td>
<td>https://hentai.cafe/</td>
<td>Chapters, Manga, Search Results, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Hentai Foundry</td>
<td>https://www.hentai-foundry.com/</td>
<td>Favorites, individual Images, Pictures, Popular Images, Recent Images, Scraps, Stories, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Hentai2Read</td>
<td>https://hentai2read.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>HentaiFox</td>
<td>https://hentaifox.com/</td>
<td>Galleries, Search Results</td>
<td></td>
</tr>
<tr>
<td>HentaiHand</td>
<td>https://hentaihand.com/</td>
<td>Galleries, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>HentaiHere</td>
<td>https://hentaihere.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Hentainexus</td>
<td>https://hentainexus.com/</td>
<td>Galleries, Search Results</td>
<td></td>
</tr>
<tr>
<td>Hiperdex</td>
<td>https://hiperdex.com/</td>
<td>Artists, Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Hitomi.la</td>
<td>https://hitomi.la/</td>
<td>Galleries, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Hypnohub</td>
<td>https://hypnohub.net/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Idol Complex</td>
<td>https://idol.sankakucomplex.com/</td>
<td>Pools, Posts, Tag Searches</td>
<td>Supported</td>
</tr>
<tr>
<td>Illusioncardsbooru</td>
<td>https://illusioncards.booru.org/</td>
<td>Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>ImageBam</td>
<td>http://www.imagebam.com/</td>
<td>Galleries, individual Images</td>
<td></td>
</tr>
<tr>
<td>ImageChest</td>
<td>https://imgchest.com/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>ImageFap</td>
<td>https://www.imagefap.com/</td>
<td>Galleries, individual Images, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Imagetwist</td>
<td>https://imagetwist.com/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Imagevenue</td>
<td>http://imagevenue.com/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>ImgBB</td>
<td>https://imgbb.com/</td>
<td>Albums, individual Images, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>imgbox</td>
<td>https://imgbox.com/</td>
<td>Galleries, individual Images</td>
<td></td>
</tr>
<tr>
<td>Imgclick</td>
<td>https://imgclick.net/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Imgspice</td>
<td>https://imgspice.com/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>imgth</td>
<td>https://imgth.com/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>imgur</td>
<td>https://imgur.com/</td>
<td>Albums, Favorites, Galleries, individual Images, Search Results, Subreddits, Tag Searches, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Imxto</td>
<td>https://imx.to/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Inkbunny</td>
<td>https://inkbunny.net/</td>
<td>Posts, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>Instagram</td>
<td>https://www.instagram.com/</td>
<td>Channels, Highlights, Posts, Reels, Saved Posts, Stories, Tag Searches, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>Issuu</td>
<td>https://issuu.com/</td>
<td>Publications, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Joyreactor</td>
<td>http://joyreactor.cc/</td>
<td>Posts, Search Results, Tag Searches, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Keenspot</td>
<td>http://www.keenspot.com/</td>
<td>Comics</td>
<td></td>
</tr>
<tr>
<td>Kemonoparty</td>
<td>https://kemono.party/</td>
<td>Posts, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Khinsider</td>
<td>https://downloads.khinsider.com/</td>
<td>Soundtracks</td>
<td></td>
</tr>
<tr>
<td>Kirei Cake</td>
<td>https://reader.kireicake.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Komikcast</td>
<td>https://komikcast.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Konachan</td>
<td>https://konachan.com/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>LINE BLOG</td>
<td>https://www.lineblog.me/</td>
<td>Blogs, Posts</td>
<td></td>
</tr>
<tr>
<td>livedoor Blog</td>
<td>http://blog.livedoor.jp/</td>
<td>Blogs, Posts</td>
<td></td>
</tr>
<tr>
<td>Lolibooru</td>
<td>https://lolibooru.moe/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Luscious</td>
<td>https://members.luscious.net/</td>
<td>Albums, Search Results</td>
<td></td>
</tr>
<tr>
<td>Manga Fox</td>
<td>https://fanfox.net/</td>
<td>Chapters</td>
<td></td>
</tr>
<tr>
<td>Manga Here</td>
<td>https://www.mangahere.cc/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Manga Stream</td>
<td>https://readms.net/</td>
<td>Chapters</td>
<td></td>
</tr>
<tr>
<td>MangaDex</td>
<td>https://mangadex.org/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>MangaKakalot</td>
<td>https://mangakakalot.com/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>MangaPark</td>
<td>https://mangapark.net/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Mangareader</td>
<td>https://www.mangareader.net/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Mangoxo</td>
<td>https://www.mangoxo.com/</td>
<td>Albums, Channels</td>
<td>Supported</td>
</tr>
<tr>
<td>mastodon.social</td>
<td>https://mastodon.social/</td>
<td>Images from Statuses, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>My Hentai Gallery</td>
<td>https://myhentaigallery.com/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>Naver</td>
<td>https://blog.naver.com/</td>
<td>Blogs, Posts</td>
<td></td>
</tr>
<tr>
<td>NaverWebtoon</td>
<td>https://comic.naver.com/</td>
<td>Comics, Episodes</td>
<td></td>
</tr>
<tr>
<td>Newgrounds</td>
<td>https://www.newgrounds.com/</td>
<td>Art, Audio, Favorites, individual Images, Media Files, Movies, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>Ngomik</td>
<td>http://ngomik.in/</td>
<td>Chapters</td>
<td></td>
</tr>
<tr>
<td>nhentai</td>
<td>https://nhentai.net/</td>
<td>Galleries, Search Results</td>
<td></td>
</tr>
<tr>
<td>Niconico Seiga</td>
<td>https://seiga.nicovideo.jp/</td>
<td>individual Images, User Profiles</td>
<td>Required</td>
</tr>
<tr>
<td>nijie</td>
<td>https://nijie.info/</td>
<td>Doujin, Favorites, Illustrations, individual Images, User Profiles</td>
<td>Required</td>
</tr>
<tr>
<td>Nozomi.la</td>
<td>https://nozomi.la/</td>
<td>Site Index, Posts, Search Results, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>NSFWalbum.com</td>
<td>https://nsfwalbum.com/</td>
<td>Albums</td>
<td></td>
</tr>
<tr>
<td>Nyafuu Archive</td>
<td>https://archive.nyafuu.org/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Patreon</td>
<td>https://www.patreon.com/</td>
<td>Creators, Posts, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#cookies">Cookies</a></td>
</tr>
<tr>
<td>Pawoo</td>
<td>https://pawoo.net/</td>
<td>Images from Statuses, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Photobucket</td>
<td>https://photobucket.com/</td>
<td>Albums, individual Images</td>
<td></td>
</tr>
<tr>
<td>PhotoVogue</td>
<td>https://www.vogue.it/en/photovogue/</td>
<td>User Profiles</td>
<td></td>
</tr>
<tr>
<td>Piczel</td>
<td>https://piczel.tv/</td>
<td>Folders, individual Images, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Pillowfort</td>
<td>https://www.pillowfort.social/</td>
<td>Posts, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Pinterest</td>
<td>https://www.pinterest.com/</td>
<td>Pins, pin.it Links, related Pins, Sections, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>Pixhost</td>
<td>https://pixhost.to/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Pixiv</td>
<td>https://www.pixiv.net/</td>
<td>Favorites, Follows, pixiv.me Links, Rankings, Search Results, User Profiles, individual Images</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Pixnet</td>
<td>https://www.pixnet.net/</td>
<td>Folders, individual Images, Sets, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Plurk</td>
<td>https://www.plurk.com/</td>
<td>Posts, Timelines</td>
<td></td>
</tr>
<tr>
<td>Pornhub</td>
<td>https://www.pornhub.com/</td>
<td>Galleries, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Pornreactor</td>
<td>http://pornreactor.cc/</td>
<td>Posts, Search Results, Tag Searches, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Postimg</td>
<td>https://postimages.org/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>PowerManga</td>
<td>https://read.powermanga.org/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Pururin</td>
<td>https://pururin.io/</td>
<td>Galleries</td>
<td></td>
</tr>
<tr>
<td>Read Comic Online</td>
<td>https://readcomiconline.to/</td>
<td>Comic Issues, Comics</td>
<td></td>
</tr>
<tr>
<td>Realbooru</td>
<td>https://realbooru.com/</td>
<td>Pools, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>RebeccaBlackTech</td>
<td>https://rbt.asia/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Reddit</td>
<td>https://www.reddit.com/</td>
<td>individual Images, Submissions, Subreddits, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>RedGIFs</td>
<td>https://redgifs.com/</td>
<td>individual Images, Search Results, User Profiles</td>
<td></td>
</tr>
<tr>
<td>rule #34</td>
<td>https://rule34.paheal.net/</td>
<td>Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Rule 34</td>
<td>https://rule34.xxx/</td>
<td>Pools, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Safebooru</td>
<td>https://safebooru.org/</td>
<td>Pools, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Sakugabooru</td>
<td>https://www.sakugabooru.com/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Sankaku Channel</td>
<td>https://sankaku.app/</td>
<td>Book Searches, Pools, Posts, Tag Searches</td>
<td>Supported</td>
</tr>
<tr>
<td>Sankaku Complex</td>
<td>https://www.sankakucomplex.com/</td>
<td>Articles, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Sen Manga</td>
<td>https://raw.senmanga.com/</td>
<td>Chapters</td>
<td></td>
</tr>
<tr>
<td>Sense-Scans</td>
<td>https://sensescans.com/reader/</td>
<td>Chapters, Manga</td>
<td></td>
</tr>
<tr>
<td>Sex.com</td>
<td>https://www.sex.com/</td>
<td>Boards, Pins, related Pins, Search Results</td>
<td></td>
</tr>
<tr>
<td>Simply Hentai</td>
<td>https://www.simply-hentai.com/</td>
<td>Galleries, individual Images, Videos</td>
<td></td>
</tr>
<tr>
<td>SlickPic</td>
<td>https://www.slickpic.com/</td>
<td>Albums, User Profiles</td>
<td></td>
</tr>
<tr>
<td>SlideShare</td>
<td>https://www.slideshare.net/</td>
<td>Presentations</td>
<td></td>
</tr>
<tr>
<td>SmugMug</td>
<td>https://www.smugmug.com/</td>
<td>Albums, individual Images, Images from Users and Folders</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>Speaker Deck</td>
<td>https://speakerdeck.com/</td>
<td>Presentations</td>
<td></td>
</tr>
<tr>
<td>SubscribeStar</td>
<td>https://www.subscribestar.com/</td>
<td>Posts, User Profiles</td>
<td>Supported</td>
</tr>
<tr>
<td>Tbib</td>
<td>https://tbib.org/</td>
<td>Pools, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>The /b/ Archive</td>
<td>https://thebarchive.com/</td>
<td>Boards, Search Results, Threads</td>
<td></td>
</tr>
<tr>
<td>Thecollection</td>
<td>https://the-collection.booru.org/</td>
<td>Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>Tsumino</td>
<td>https://www.tsumino.com/</td>
<td>Galleries, Search Results</td>
<td>Supported</td>
</tr>
<tr>
<td>Tumblr</td>
<td>https://www.tumblr.com/</td>
<td>Likes, Posts, Tag Searches, User Profiles</td>
<td><a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a></td>
</tr>
<tr>
<td>TumblrGallery</td>
<td>https://tumblrgallery.xyz/</td>
<td>Posts, Search Results, Tumblrblogs</td>
<td></td>
</tr>
<tr>
<td>Turboimagehost</td>
<td>https://www.turboimagehost.com/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>Twitter</td>
<td>https://twitter.com/</td>
<td>Bookmarks, Likes, Lists, List Members, Media Timelines, Search Results, Timelines, Tweets</td>
<td>Supported</td>
</tr>
<tr>
<td>Unsplash</td>
<td>https://unsplash.com/</td>
<td>Collections, Favorites, individual Images, Search Results, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Vipr</td>
<td>https://vipr.im/</td>
<td>individual Images</td>
<td></td>
</tr>
<tr>
<td>VSCO</td>
<td>https://vsco.co/</td>
<td>Collections, individual Images, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Wallhaven</td>
<td>https://wallhaven.cc/</td>
<td>Collections, individual Images, Search Results</td>
<td><a href="configuration.rst#extractorwallhavenapi-key">API Key</a></td>
</tr>
<tr>
<td>Warosu</td>
<td>https://warosu.org/</td>
<td>Threads</td>
<td></td>
</tr>
<tr>
<td>Weasyl</td>
<td>https://www.weasyl.com/</td>
<td>Favorites, Folders, Journals, Submissions</td>
<td><a href="configuration.rst#extractorweasylapi-key">API Key</a></td>
</tr>
<tr>
<td>Webtoon</td>
<td>https://www.webtoons.com/</td>
<td>Comics, Episodes</td>
<td></td>
</tr>
<tr>
<td>Weibo</td>
<td>https://www.weibo.com/</td>
<td>Images from Statuses, User Profiles</td>
<td></td>
</tr>
<tr>
<td>WikiArt.org</td>
<td>https://www.wikiart.org/</td>
<td>Artists, Artist Listings, Artworks, individual Images</td>
<td></td>
</tr>
<tr>
<td>xHamster</td>
<td>https://xhamster.com/</td>
<td>Galleries, User Profiles</td>
<td></td>
</tr>
<tr>
<td>XVideos</td>
<td>https://www.xvideos.com/</td>
<td>Galleries, User Profiles</td>
<td></td>
</tr>
<tr>
<td>Yandere</td>
<td>https://yande.re/</td>
<td>Pools, Popular Images, Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>yuki.la 4chan archive</td>
<td>https://yuki.la/</td>
<td>Threads</td>
<td></td>
</tr>
<tr>
<td>かべうち</td>
<td>https://kabe-uchiroom.com/</td>
<td>User Profiles</td>
<td></td>
</tr>
<tr>
<td>もえぴりあ</td>
<td>https://vanilla-rock.com/</td>
<td>Posts, Tag Searches</td>
<td></td>
</tr>
<tr>
<td>半次元</td>
<td>https://bcy.net/</td>
<td>Posts, User Profiles</td>
<td></td>
</tr>
</tbody>
</table>

188
docs/supportedsites.rst
Unescape View File

@ -1,188 +0,0 @@
Supported Sites
===============
..
generated by scripts/supportedsites.py
Consider all sites to be NSFW, unless otherwise known.
==================== =================================== ================================================== ================
Site URL Capabilities Authentication
==================== =================================== ================================================== ================
35PHOTO https://35photo.pro/ |35photo-C|
3dbooru http://behoimi.org/ Pools, Popular Images, Posts, Tag Searches
4chan https://www.4chan.org/ Boards, Threads
4plebs https://archive.4plebs.org/ Boards, Search Results, Threads
500px https://500px.com/ Galleries, individual Images, User Profiles
8kun https://8kun.top/ Boards, Threads
8muses https://comics.8muses.com/ Albums
Acidimg https://acidimg.cc/ individual Images
Adobe Portfolio https://www.myportfolio.com/ Galleries
Adult Empire https://www.adultempire.com/ Galleries
Allgirlbooru https://allgirl.booru.org/ Posts, Tag Searches
arch.b4k.co https://arch.b4k.co/ Boards, Search Results, Threads
Archive of Sins https://archiveofsins.com/ Boards, Search Results, Threads
Archived.Moe https://archived.moe/ Boards, Search Results, Threads
ArtStation https://www.artstation.com/ |artstation-C|
baraag https://baraag.net/ Images from Statuses, User Profiles `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Behance https://www.behance.net/ Collections, Galleries, User Profiles
Blogger https://www.blogger.com/ Blogs, Posts, Search Results
Cyberdrop https://cyberdrop.me/ Albums
Danbooru https://danbooru.donmai.us/ Pools, Popular Images, Posts, Tag Searches Supported
Derpibooru https://derpibooru.org/ Galleries, Posts, Search Results `API Key <configuration.rst#extractorderpibooruapi-key>`__
Desuarchive https://desuarchive.org/ Boards, Search Results, Threads
DeviantArt https://www.deviantart.com/ |deviantart-C| `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Doki Reader https://kobato.hologfx.com/reader/ Chapters, Manga
Dynasty Reader https://dynasty-scans.com/ Chapters, individual Images, Search Results
E-Hentai https://e-hentai.org/ Favorites, Galleries, Search Results Supported
e621 https://e621.net/ Pools, Popular Images, Posts, Tag Searches Supported
Eka's Portal https://aryion.com/ Galleries, Posts Supported
EroMe https://www.erome.com/ Albums, Search Results, User Profiles
ExHentai https://exhentai.org/ Favorites, Galleries, Search Results Supported
Fallen Angels Scans https://www.fascans.com/ Chapters, Manga
Fashion Nova https://www.fashionnova.com/ Collections, Products
Fireden https://boards.fireden.net/ Boards, Search Results, Threads
Flickr https://www.flickr.com/ |flickr-C| `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Fur Affinity https://www.furaffinity.net/ |furaffinity-C| `Cookies <https://github.com/mikf/gallery-dl#cookies>`__
Fuskator https://fuskator.com/ Galleries, Search Results
Futaba Channel https://www.2chan.net/ Threads
Gelbooru https://gelbooru.com/ Pools, Posts, Tag Searches
Gfycat https://gfycat.com/ individual Images, Search Results, User Profiles
HBrowse https://www.hbrowse.com/ Chapters, Manga
Hentai Cafe https://hentai.cafe/ Chapters, Manga, Search Results, Tag Searches
Hentai Foundry https://www.hentai-foundry.com/ |hentaifoundry-C|
Hentai2Read https://hentai2read.com/ Chapters, Manga
HentaiFox https://hentaifox.com/ Galleries, Search Results
HentaiHand https://hentaihand.com/ Galleries, Tag Searches
HentaiHere https://hentaihere.com/ Chapters, Manga
Hentainexus https://hentainexus.com/ Galleries, Search Results
Hiperdex https://hiperdex.com/ Artists, Chapters, Manga
Hitomi.la https://hitomi.la/ Galleries, Tag Searches
Hypnohub https://hypnohub.net/ Pools, Popular Images, Posts, Tag Searches
Idol Complex https://idol.sankakucomplex.com/ Pools, Posts, Tag Searches Supported
Illusioncardsbooru https://illusioncards.booru.org/ Posts, Tag Searches
ImageBam http://www.imagebam.com/ Galleries, individual Images
ImageChest https://imgchest.com/ Galleries
ImageFap https://www.imagefap.com/ Galleries, individual Images, User Profiles
Imagetwist https://imagetwist.com/ individual Images
Imagevenue http://imagevenue.com/ individual Images
ImgBB https://imgbb.com/ Albums, individual Images, User Profiles Supported
imgbox https://imgbox.com/ Galleries, individual Images
Imgclick https://imgclick.net/ individual Images
Imgspice https://imgspice.com/ individual Images
imgth https://imgth.com/ Galleries
imgur https://imgur.com/ |imgur-C|
Imxto https://imx.to/ individual Images
Inkbunny https://inkbunny.net/ Posts, User Profiles Supported
Instagram https://www.instagram.com/ |instagram-C| Supported
Issuu https://issuu.com/ Publications, User Profiles
Joyreactor http://joyreactor.cc/ Posts, Search Results, Tag Searches, User Profiles
Keenspot http://www.keenspot.com/ Comics
Kemonoparty https://kemono.party/ Posts, User Profiles
Khinsider https://downloads.khinsider.com/ Soundtracks
Kirei Cake https://reader.kireicake.com/ Chapters, Manga
Komikcast https://komikcast.com/ Chapters, Manga
Konachan https://konachan.com/ Pools, Popular Images, Posts, Tag Searches
LINE BLOG https://www.lineblog.me/ Blogs, Posts
livedoor Blog http://blog.livedoor.jp/ Blogs, Posts
Lolibooru https://lolibooru.moe/ Pools, Popular Images, Posts, Tag Searches
Luscious https://members.luscious.net/ Albums, Search Results
Manga Fox https://fanfox.net/ Chapters
Manga Here https://www.mangahere.cc/ Chapters, Manga
Manga Stream https://readms.net/ Chapters
MangaDex https://mangadex.org/ Chapters, Manga
MangaKakalot https://mangakakalot.com/ Chapters, Manga
MangaPark https://mangapark.net/ Chapters, Manga
Mangareader https://www.mangareader.net/ Chapters, Manga
Mangoxo https://www.mangoxo.com/ Albums, Channels Supported
mastodon.social https://mastodon.social/ Images from Statuses, User Profiles `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
My Hentai Gallery https://myhentaigallery.com/ Galleries
Naver https://blog.naver.com/ Blogs, Posts
NaverWebtoon https://comic.naver.com/ Comics, Episodes
Newgrounds https://www.newgrounds.com/ |newgrounds-C| Supported
Ngomik http://ngomik.in/ Chapters
nhentai https://nhentai.net/ Galleries, Search Results
Niconico Seiga https://seiga.nicovideo.jp/ individual Images, User Profiles Required
nijie https://nijie.info/ |nijie-C| Required
Nozomi.la https://nozomi.la/ Site Index, Posts, Search Results, Tag Searches
NSFWalbum.com https://nsfwalbum.com/ Albums
Nyafuu Archive https://archive.nyafuu.org/ Boards, Search Results, Threads
Patreon https://www.patreon.com/ Creators, Posts, User Profiles `Cookies <https://github.com/mikf/gallery-dl#cookies>`__
Pawoo https://pawoo.net/ Images from Statuses, User Profiles `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Photobucket https://photobucket.com/ Albums, individual Images
PhotoVogue https://www.vogue.it/en/photovogue/ User Profiles
Piczel https://piczel.tv/ Folders, individual Images, User Profiles
Pillowfort https://www.pillowfort.social/ Posts, User Profiles
Pinterest https://www.pinterest.com/ |pinterest-C| Supported
Pixhost https://pixhost.to/ individual Images
Pixiv https://www.pixiv.net/ |pixiv-C| `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Pixnet https://www.pixnet.net/ Folders, individual Images, Sets, User Profiles
Plurk https://www.plurk.com/ Posts, Timelines
Pornhub https://www.pornhub.com/ Galleries, User Profiles
Pornreactor http://pornreactor.cc/ Posts, Search Results, Tag Searches, User Profiles
Postimg https://postimages.org/ individual Images
PowerManga https://read.powermanga.org/ Chapters, Manga
Pururin https://pururin.io/ Galleries
Read Comic Online https://readcomiconline.to/ Comic Issues, Comics
Realbooru https://realbooru.com/ Pools, Posts, Tag Searches
RebeccaBlackTech https://rbt.asia/ Boards, Search Results, Threads
Reddit https://www.reddit.com/ |reddit-C| `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
RedGIFs https://redgifs.com/ individual Images, Search Results, User Profiles
rule #34 https://rule34.paheal.net/ Posts, Tag Searches
Rule 34 https://rule34.xxx/ Pools, Posts, Tag Searches
Safebooru https://safebooru.org/ Pools, Posts, Tag Searches
Sakugabooru https://www.sakugabooru.com/ Pools, Popular Images, Posts, Tag Searches
Sankaku Channel https://sankaku.app/ Book Searches, Pools, Posts, Tag Searches Supported
Sankaku Complex https://www.sankakucomplex.com/ Articles, Tag Searches
Sen Manga https://raw.senmanga.com/ Chapters
Sense-Scans https://sensescans.com/reader/ Chapters, Manga
Sex.com https://www.sex.com/ Boards, Pins, related Pins, Search Results
Simply Hentai https://www.simply-hentai.com/ Galleries, individual Images, Videos
SlickPic https://www.slickpic.com/ Albums, User Profiles
SlideShare https://www.slideshare.net/ Presentations
SmugMug https://www.smugmug.com/ |smugmug-C| `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
Speaker Deck https://speakerdeck.com/ Presentations
SubscribeStar https://www.subscribestar.com/ Posts, User Profiles Supported
Tbib https://tbib.org/ Pools, Posts, Tag Searches
The /b/ Archive https://thebarchive.com/ Boards, Search Results, Threads
Thecollection https://the-collection.booru.org/ Posts, Tag Searches
Tsumino https://www.tsumino.com/ Galleries, Search Results Supported
Tumblr https://www.tumblr.com/ Likes, Posts, Tag Searches, User Profiles `OAuth <https://github.com/mikf/gallery-dl#oauth>`__
TumblrGallery https://tumblrgallery.xyz/ Posts, Search Results, Tumblrblogs
Turboimagehost https://www.turboimagehost.com/ individual Images
Twitter https://twitter.com/ |twitter-C| Supported
Unsplash https://unsplash.com/ |unsplash-C|
Vipr https://vipr.im/ individual Images
VSCO https://vsco.co/ Collections, individual Images, User Profiles
Wallhaven https://wallhaven.cc/ Collections, individual Images, Search Results `API Key <configuration.rst#extractorwallhavenapi-key>`__
Warosu https://warosu.org/ Threads
Weasyl https://www.weasyl.com/ Favorites, Folders, Journals, Submissions `API Key <configuration.rst#extractorweasylapi-key>`__
Webtoon https://www.webtoons.com/ Comics, Episodes
Weibo https://www.weibo.com/ Images from Statuses, User Profiles
WikiArt.org https://www.wikiart.org/ |wikiart-C|
xHamster https://xhamster.com/ Galleries, User Profiles
XVideos https://www.xvideos.com/ Galleries, User Profiles
Yandere https://yande.re/ Pools, Popular Images, Posts, Tag Searches
|yuki-S| https://yuki.la/ Threads
かべうち https://kabe-uchiroom.com/ User Profiles
もえぴりあ https://vanilla-rock.com/ Posts, Tag Searches
半次元 https://bcy.net/ Posts, User Profiles
==================== =================================== ================================================== ================
.. |35photo-C| replace:: Genres, individual Images, Tag Searches, User Profiles
.. |artstation-C| replace:: Albums, Artwork Listings, Challenges, individual Images, Likes, Search Results, User Profiles
.. |deviantart-C| replace:: Collections, Deviations, Favorites, Folders, Galleries, Journals, Popular Images, Scraps, Sta.sh, User Profiles
.. |flickr-C| replace:: Albums, Favorites, Galleries, Groups, individual Images, Search Results, User Profiles
.. |furaffinity-C| replace:: Favorites, Galleries, Posts, Scraps, Search Results, User Profiles
.. |hentaifoundry-C| replace:: Favorites, individual Images, Pictures, Popular Images, Recent Images, Scraps, Stories, User Profiles
.. |imgur-C| replace:: Albums, Favorites, Galleries, individual Images, Search Results, Subreddits, Tag Searches, User Profiles
.. |instagram-C| replace:: Channels, Highlights, Posts, Reels, Saved Posts, Stories, Tag Searches, User Profiles
.. |newgrounds-C| replace:: Art, Audio, Favorites, individual Images, Media Files, Movies, User Profiles
.. |nijie-C| replace:: Doujin, Favorites, Illustrations, individual Images, User Profiles
.. |pinterest-C| replace:: Pins, pin.it Links, related Pins, Sections, User Profiles
.. |pixiv-C| replace:: Favorites, Follows, pixiv.me Links, Rankings, Search Results, User Profiles, individual Images
.. |reddit-C| replace:: individual Images, Submissions, Subreddits, User Profiles
.. |smugmug-C| replace:: Albums, individual Images, Images from Users and Folders
.. |twitter-C| replace:: Bookmarks, Likes, Lists, List Members, Media Timelines, Search Results, Timelines, Tweets
.. |unsplash-C| replace:: Collections, Favorites, individual Images, Search Results, User Profiles
.. |wikiart-C| replace:: Artists, Artist Listings, Artworks, individual Images
.. |yuki-S| replace:: yuki.la 4chan archive

2
scripts/release.sh
Unescape View File

@ -128,7 +128,7 @@ upload-pypi() {
ROOTDIR="$(realpath "$(dirname "$0")/..")/"
README="README.rst"
CHANGELOG="CHANGELOG.md"
SUPPORTEDSITES="./docs/supportedsites.rst"
SUPPORTEDSITES="./docs/supportedsites.md"
LASTTAG="$(git describe --abbrev=0 --tags)"
OLDVERSION="${LASTTAG#v}"

96
scripts/supportedsites.py
Unescape View File

@ -167,11 +167,14 @@ SUBCATEGORY_MAP = {
},
}
_OAUTH = "`OAuth <https://github.com/mikf/gallery-dl#oauth>`__"
_COOKIES = "`Cookies <https://github.com/mikf/gallery-dl#cookies>`__"
_APIKEY_DB = "`API Key <configuration.rst#extractorderpibooruapi-key>`__"
_APIKEY_WH = "`API Key <configuration.rst#extractorwallhavenapi-key>`__"
_APIKEY_WY = "`API Key <configuration.rst#extractorweasylapi-key>`__"
_OAUTH = '<a href="https://github.com/mikf/gallery-dl#oauth">OAuth</a>'
_COOKIES = '<a href="https://github.com/mikf/gallery-dl#cookies">Cookies</a>'
_APIKEY_DB = \
'<a href="configuration.rst#extractorderpibooruapi-key">API Key</a>'
_APIKEY_WH = \
'<a href="configuration.rst#extractorwallhavenapi-key">API Key</a>'
_APIKEY_WY = \
'<a href="configuration.rst#extractorweasylapi-key">API Key</a>'
AUTH_MAP = {
"aryion" : "Supported",
@ -314,55 +317,48 @@ COLUMNS = (
)
def write_output(fp, columns, categories, domains):
def generate_output(columns, categories, domains):
def pad(output, col, category=None):
size = col[1]
output = output if isinstance(output, str) else col[2](output)
thead = []
append = thead.append
append("<tr>")
for column in columns:
append(" <th>" + column[0] + "</th>")
append("</tr>")
if len(output) > size and col[0][0] != "A":
sub = "|{}-{}|".format(category, col[0][0])
subs.append((sub, output))
output = sub
return output + " " * (size - len(output))
w = fp.write
subs = []
# caption
w("Supported Sites\n")
w("===============\n")
w("..\n generated by {}\n\n".format(
"/".join(os.path.normpath(__file__).split(os.sep)[-2:])))
w("Consider all sites to be NSFW, unless otherwise known.\n\n")
# table head
sep = " ".join("=" * c[1] for c in columns) + "\n"
w(sep)
w(" ".join(pad(c[0], c) for c in columns).strip() + "\n")
w(sep)
# table body
tbody = []
append = tbody.append
clist = sorted(categories.items(), key=category_key)
for category, subcategories in clist:
domain = domains[category]
w(" ".join(
pad(col[2](category, subcategories, domain), col, category)
for col in columns
).strip())
w("\n")
# table bottom
w(sep)
w("\n")
# substitutions
for sub, value in subs:
w(".. {} replace:: {}\n".format(sub, value))
append("<tr>")
for column in columns:
domain = domains[category]
content = column[2](category, subcategories, domain)
append(" <td>" + content + "</td>")
append("</tr>")
TEMPLATE = """# Supported Sites
<!-- auto-generated by {} -->
Consider all sites to be NSFW unless otherwise known.
<table>
<thead valign="bottom">
{}
</thead>
<tbody valign="top">
{}
</tbody>
</table>
"""
return TEMPLATE.format(
"/".join(os.path.normpath(__file__).split(os.sep)[-2:]),
"\n".join(thead),
"\n".join(tbody),
)
categories, domains = build_extractor_list()
outfile = sys.argv[1] if len(sys.argv) > 1 else "supportedsites.rst"
with open(util.path("docs", outfile), "w") as file:
write_output(file, COLUMNS, categories, domains)
outfile = sys.argv[1] if len(sys.argv) > 1 else "supportedsites.md"
with open(util.path("docs", outfile), "w") as fp:
fp.write(generate_output(COLUMNS, categories, domains))

Write Preview
Loading…
Cancel
Save