717 Commits (1171911dc3c8c739f8eac1e16a42bfd53cce6ac7)

Author	SHA1	Message	Date
Mike Fährmann	266ed9b62e	[aryion] add 'tag' extractor (closes #1849)	3 years ago
Mike Fährmann	c9e6693530	allow specifying a minimum/maximum for 'sleep-*' options (#1835) ... for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10 seconds between each HTTP request	3 years ago
Mike Fährmann	bd845303ad	implement a way to shorten filenames with east-asian characters ... (#1377) Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower algorithm that also considers characters with a width > 1.	3 years ago
Mike Fährmann	7bbb1f92d7	[gelbooru_v02] add 'favorite' extractor (closes #1834)	3 years ago
Mike Fährmann	4ec11af6a4	[kemonoparty] implement login with username & password (#1824)	3 years ago
Mike Fährmann	83bbb628d8	[kemonoparty] add 'favorite' extractor (#1824)	3 years ago
Mike Fährmann	44f572c27f	[deviantart] implement a 'auto-unwatch' option (#1466, #1757)	3 years ago
Mike Fährmann	268c9ca034	update default gallery-dl.conf	3 years ago
Mike Fährmann	3e36543c98	[nhentai] add 'favorite' extractor (#1814)	3 years ago
Mike Fährmann	96fec14ef7	[deviantart] rename 'watch' option to 'auto-watch' ... (#1466, #1757) Similar reason as in e05a96db. 'watch' is already used by the WatchExtractor class.	3 years ago
Mike Fährmann	e75f2de9da	[deviantart] add 'comments' option (#1800)	3 years ago
Mike Fährmann	6ce16c6d31	[deviantart] add 'tag' extractor (closes #1803)	3 years ago
Mike Fährmann	4e9f8fe395	[shopify] support windsorstore.com (#1793)	3 years ago
Mike Fährmann	292fffc83c	add 'j' format string conversion ... to convert to a JSON formatted string	3 years ago
Mike Fährmann	ecc8da4704	[deviantart] implement a 'watch' option (#1466, #1757)	3 years ago
Mike Fährmann	d3eab417ed	implement a 'path-strip' option	3 years ago
Mike Fährmann	c04f7ab139	[foolfuuka] add 'gallery' extractor (#1785)	3 years ago
Mike Fährmann	20ee091289	[429chan] add 'thread' and 'board' extractors (closes #1773)	3 years ago
Mike Fährmann	51eb50749f	[foolslide] remove entry for kobato.hologfx.com	3 years ago
Mike Fährmann	d320ee6251	implement a 'fallback' option (closes #1770)	3 years ago
Mike Fährmann	c866fcba48	[twitter] fix 'logout' (#1719) ... delete 'auth_token' cookie and cookies.txt path	3 years ago
Mike Fährmann	ed4b3c48cb	fix flake8 and other tests	3 years ago
Nyasume	fa6af46756	Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701)	3 years ago
Mike Fährmann	e5a93e113f	[twitter] extend 'replies' option (#1254) ... Allow setting 'replies to '"self"' to only download from self-replies.	3 years ago
Mike Fährmann	cadfad4eea	[danbooru] add 'external' option (closes #1747)	3 years ago
Mike Fährmann	5b1c62bfa9	[furaffinity] add 'external' option (closes #1492)	3 years ago
Mike Fährmann	a316e44f8e	[bbc] add 'width' option (#1706)	3 years ago
Mike Fährmann	7a0da4f93f	[newgrounds] add 'format' option (closes #1729)	3 years ago
Mike Fährmann	486474800f	[kemonoparty] skip duplicated patreon files (closes #1689) ... this behavior can be disabled with the 'patreon-skip-file' option	3 years ago
Mike Fährmann	da7297c0b9	[comicvine] add extractor (closes #1712)	3 years ago
Mike Fährmann	e4788fa663	[bbc] add 'gallery' and 'programme' extractors (closes #1706)	3 years ago
Mike Fährmann	13d4045a8a	add 'archive-prefix' option (#1711)	3 years ago
Mike Fährmann	74b457b2b5	remove unused entries	3 years ago
Mike Fährmann	3868ec02d1	[pururin] update domain and fix extraction	3 years ago
Mike Fährmann	b9783403d9	add 'url-metadata' option (#1659, #1073)	3 years ago
Mike Fährmann	e95f99882f	extend 'parent-metadata' functionality (#1687, #1651, #1364)	3 years ago
Mike Fährmann	dff0da60f9	[ytdl] add 'generic' option (#1680)	3 years ago
Mike Fährmann	36ac2197db	[ytdl] add extractor for sites supported by youtube-dl ... (#1680, #878) Can be used by prefixing any URL with 'ytdl:', or by setting 'extractor,ytdl.enabled' to 'true'.	3 years ago
Mike Fährmann	8b036778e3	[kemonoparty] add 'max-posts' option (#1674)	3 years ago
Mike Fährmann	8ecca3af58	[pixiv] add extractor for 'pixivision' articles (#1672)	3 years ago
Mike Fährmann	312a28e78a	[mastodon] add 'replies' option (#1669)	3 years ago
Mike Fährmann	a1f5b78039	[mastodon] add 'reblogs' option (#1669)	3 years ago
Mike Fährmann	317ecc8180	use HTML tables in docs/formatting.md	3 years ago
Mike Fährmann	7f591c78cb	[mangafox] cleanup	3 years ago
Mike Fährmann	93d356712c	[mastodon] implement 'text-posts' option (#1569) ... similar to Twitter's 'text-tweets'	3 years ago
Mike Fährmann	963d177a68	document format string syntax ... or at least attempt to	3 years ago
Mike Fährmann	267bbf5996	[mangasee] add 'chapter' and 'manga' extractors	3 years ago
Mike Fährmann	f74cf52e2b	[seisoparty] add 'user' and 'post' extractors (#1635)	3 years ago
Mike Fährmann	e661607e8b	[mangadex] document 'metadata' and 'lang' options (#1535)	3 years ago
Mike Fährmann	fd00d47116	implement conditional directories (#1394) ... They work the same way as conditional filenames (84d2e640), e.g. "directory": { "score >= 20": ["high score"], "score >= 5" : ["mid score"], "" : ["{category}", "default"] }	3 years ago
Mike Fährmann	a751afdfb3	[twitter] change some defaults ... - 'retweets' option: true -> false - 'quoted' option : true -> false i.e. disable downloading tweets from other user's timelines by default - search directory: '["{category}", "Search", "{search}"]' -> '["{category}", "{user[name]}"]' i.e. change it to the same as other twitter extractors (#1308)	3 years ago
Mike Fährmann	84d2e64024	combine conditional filenames into `filename` option (#1394)	3 years ago
Mike Fährmann	1197ee2c20	[mangadex] add extractor for a user's followed feed (#1535)	3 years ago
Mike Fährmann	07c8adbd8b	[mangadex] implement login with username & password (#1535)	3 years ago
Mike Fährmann	3cbbefd4ed	support 'filter' option for post processors (#1460)	3 years ago
Mike Fährmann	4cf40434d7	initial support for conditional filenames (#1394)	3 years ago
Mike Fährmann	f3d692a378	improve docs for danbooru and e621 passwords (#1593, #1596)	3 years ago
Mike Fährmann	407627ec86	[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595)	3 years ago
Mike Fährmann	52052a0e1a	[manganelo] update domain to 'manganato.com'	3 years ago
Mike Fährmann	c80b18a477	[weibo] extend 'retweets' option (closes #1542) ... Setting 'retweets' to "original" will use metadata from the original posts, and not from the retweeted ones.	3 years ago
Mike Fährmann	74d97e6c6b	[postprocessor:ugoira] add 'repeat-last-frame' option (#1550)	3 years ago
Mike Fährmann	be9547a5f3	[postprocessor:ugoira] use 'image2' demuxer (#1550) ... Ensures exact frame timecodes with no duplicate frames. Possible issues are the duration the last frame in an Ugoira with variable frame durations is shown and insufficient timestamp precision of the underlying file system (e.g. FAT32, ext3; works on ext4, tmpfs, NTFS).	3 years ago
Mike Fährmann	b8de0671e5	update description for 'instagram.include' ... - add double quotes for "reels" - add "tagged"	3 years ago
thatfuckingbird	e6811c7450	[pixiv] implement 'max-posts' option (#1558) ... * implement max-rank for pixiv * rename to max-posts and make more generic	3 years ago
Mike Fährmann	b5affc62aa	[twitter] rename 'text-only' to 'text-tweets' (#570)	3 years ago
Mike Fährmann	724ca61f36	[twitter] add 'text-only' option (#570)	3 years ago
Mike Fährmann	1eabfa5c7a	[pillowfort] implement login with username & password (#846)	3 years ago
Mike Fährmann	a7e4917ee1	[pillowfort] add 'inline' option (#846) ... to support images present in a post's 'content', but not listed in 'media'. also separates the file hash present at the beginning of each 'filename' into its own field.	3 years ago
Mike Fährmann	efa6cc8ec3	[pillowfort] add 'external' option (#846) ... for links to external Twitter posts etc.	3 years ago
Mike Fährmann	5eeaaee01d	[pixiv] add 'metadata' option (#1551)	3 years ago
Mike Fährmann	0717456b4e	[kemonoparty] add 'metadata' option (closes #1548) ... to fetch creator names with an additional HTTP request	3 years ago
Mike Fährmann	7ab8374385	add 'parent-skip' option (#1399)	3 years ago
Mike Fährmann	c693db5b1a	add '"skip": "terminate"' option ... Stops not only the current extractor/job, but all parent extractors/jobs as well.	3 years ago
Mike Fährmann	36ed1efcfb	[pixiv] rename "noop" value for 'tags' option to "original" ... (#1507)	3 years ago
Mike Fährmann	4e1d33cea3	update default gallery-dl.conf ... add (empty) entries for - deviantart.client-id and deviantart.client-secret - pixiv.refresh-token	3 years ago
Mike Fährmann	3e4ffb0821	[gelbooru] add extractor for '/redirect.php' URLs (#1530)	3 years ago
Mike Fährmann	15b0241bbc	[imagebam] fix extraction	3 years ago
Mike Fährmann	38ae61edd4	[inkbunny] add 'favorite' extractor (#1521)	3 years ago
Mike Fährmann	e300da1424	add 'output.skip' option	3 years ago
Mike Fährmann	2133f1d77f	[readcomiconline] change domain to 'readcomiconline.li' ... (closes #1517)	3 years ago
Mike Fährmann	fa519f9202	[pixiv] change 'translated-tags' option (#1507) ... - rename to 'tags' - use string-values: "japanese", "translated", "noop" - remove duplicate entries for "translated" tags	3 years ago
Mike Fährmann	c6c4a73f87	update fanbox entry in supportedsites.md	3 years ago
thatfuckingbird	e47952ac14	add extractors for fantia and fanbox (#1459) ... * add extractors for fantia and fanbox * appease linter * make docstrings unique * [fantia] refactor post extraction * [fantia] capitalize * [fantia] improve regex pattern * code style * capitalize * [fanbox] use BASE_PATTERN for url regexes * [fanbox] refactor metadata and post extraction * [fanbox] improve url base pattern * [fanbox] accept creator page links ending with /posts * [fanbox] more tests * [fantia] improved pagination * [fanbox] misc. code logic improvements * [fantia] finish restructuring pagination code * [fanbox] avoid making a request for each individual post when processing a creator page * [fanbox] support embedded videos * [fanbox] fix errors * [fanbox] document extractor.fanbox.videos * [fanbox] handle "article" and "entry" post types, all embeds * [fanbox] fix downloading of embedded fanbox posts	3 years ago
Mike Fährmann	77a9cc6fd6	update supportedsites.md entry for Instagram	3 years ago
Mike Fährmann	9514cb8c12	[exhentai] update 'limits' check (#1487) ... Only use 'limits' to set a custom upper bound. Checking if the actual maximum gets exceeded is not necessary.	3 years ago
Renan Vedovato Traba	9322c5e43b	[exhentai] restore limit config (#1487) ... This partially reverts commit e9ec91c8	3 years ago
Hans Christian Gunawan	334d690687	[hentaicosplays] Add extractor (#1473)	3 years ago
Mike Fährmann	086925e685	[shopify] support omgmiamiswimwear.com (closes #1280)	3 years ago
thatfuckingbird	224b883ff4	[danbooru] add option for extended metadata extraction (#1458) ... * [danbooru] add option for extended metadata extraction * appease linter * [danbooru] update docs/configuration.rst * [danbooru] rename extended-metadata -> metadata	3 years ago
thatfuckingbird	dff03a6605	[booru] add an option to extract notes (only gelbooru for now) (#1457) ... * [booru] add an option to extract notes (currently implemented only for gelbooru) * appease linter * [gelbooru] rename "text" to "body" in note extraction * add a code comment about reusing return value of _extended_tags	3 years ago
Mike Fährmann	78d7ee3ef4	[yuki] remove module for yuki.la	3 years ago
Mike Fährmann	a86ffb04bb	add 'output.fallback' option ... to enable/disable fallback URLs for -g/--get-urls	3 years ago
FollieHiyuki	e3b9f88540	Add manganelo extractor (#1415)	4 years ago
Mike Fährmann	105f3c9666	[twitter] add extractor for direct image links (closes #1417)	4 years ago
Mike Fährmann	ec3d5d58a8	[vk] improve extractor (#474) ... - fetch all photos - add 'metadata' option - fix extracting photos without '?' in URL	4 years ago
Mike Fährmann	d5aad999dc	[tapas] implement login with username & password (#692)	4 years ago
Mike Fährmann	e9ec91c811	[exhentai] improve image limits check ... - check if current image is the '509 Bandwidth Exceeded' notification (https://ehgt.org/g/509.gif or https://exhentai.org/img/509.gif) - remove 'limits' option	4 years ago
Mike Fährmann	36291176bc	[pinterest] add 'search' extractor (#1411)	4 years ago
Mike Fährmann	5aa30c3669	[tapas] add 'series' and 'episode' extractors (#692)	4 years ago
Mike Fährmann	62cfee4d28	[vk] initial support for albums (#474)	4 years ago
Mike Fährmann	2846235669	[twitter] allow specifying a custom format for user results ... (#1337)	4 years ago
Mike Fährmann	b0438c8f99	Revert "[deviantart] extend 'extra' option" ... This reverts commit 5ad2b9c82b, 5c32a7bf58, and 83f465faca. (#1387, #1356)	4 years ago
Mike Fährmann	58b93635ee	[architizer] add 'firm' extractor (#1369)	4 years ago
Mike Fährmann	204523611c	[imgclick] use 'http://' for image URLs ... The TLS certificate for main.imgclick.net is invalid.	4 years ago
Mike Fährmann	69ca4e29f1	[deviantart] add 'watch' extractor (#794)	4 years ago
Mike Fährmann	fcdda6128c	[mangastream] remove module	4 years ago
Mike Fährmann	c677ea19dd	[mangareader] remove module	4 years ago
Mike Fährmann	71523aaab6	[architizer] add 'project' extractor (#1369)	4 years ago
Mike Fährmann	3378b39719	[twitter] implement 'users' option (#1337)	4 years ago
Mike Fährmann	466966bf83	[hentaicafe] remove module	4 years ago
Mike Fährmann	97641cd151	[hentainexus] remove module	4 years ago
Mike Fährmann	c485d0a956	[philomena] add generalized extractors for philomena sites ... (closes #1379)	4 years ago
Mike Fährmann	72fe9ac0f3	[gelbooru_v01] support some more boorus by default ... - https://drawfriends.booru.org/ - https://vidyart.booru.org/ - https://tlb.booru.org/	4 years ago
Mike Fährmann	ec98b2c56f	categorize sites in supportedsites.md by basecategory	4 years ago
Mike Fährmann	a67e002f40	update docs/supportedsites ... - use Markdown with inline HTML instead of reStructuredText - move file from docs/supportedsites.rst to docs/supportedsites.md - update Makefile, README, etc	4 years ago
Mike Fährmann	df94182e11	implement 'parent-metadata' option (#1364) ... experimental, might not work as expected, etc.	4 years ago
Mike Fährmann	4be27ff0fe	[nozomi] support '/index-N.html' URLs (closes #1365) ... and '/index-Popular-N.html'	4 years ago
Mike Fährmann	83f465faca	[deviantart] refactor 'extra' (#1356) ... - change its expected type to string - let users specify a list of sources (stash, posts) or 'all'	4 years ago
Mike Fährmann	5c32a7bf58	[deviantart] allow selecting source for 'extra' (#1356) ... Setting 'extra' to "stash" or "deviations" will only download embedded sta.sh content or deviations. 'true' still downloads both.	4 years ago
Mike Fährmann	a677123abb	[instagram] recognize 'reels' as option for 'include' (#1329)	4 years ago
Mike Fährmann	7440d1f112	[pixiv] add 'translated-tags' option (closes #1354) ... (a lot more straight forward than I thought ...)	4 years ago
Mike Fährmann	106cdc37c0	[instagram] support '/user/reels/' URLs (closes #1329)	4 years ago
Mike Fährmann	f59e63669b	[hentaicafe] add 'search' and 'tag' extractors (#1345)	4 years ago
Mike Fährmann	38e66940c1	[tumblrgallery] simplify	4 years ago
Mike Fährmann	6a28b7045c	update 'docs/gallery-dl.conf'	4 years ago
Mike Fährmann	bae874f370	replace 'wait-min/-max' with 'sleep-request' ... on exhentai, idolcomplex, reactor	4 years ago
Mike Fährmann	faf561b6ca	[wallhaven] add 'collection' extractor (#1351)	4 years ago
Mike Fährmann	1a38fae785	add option to use different youtube-dl modules (fixes #1330) ... by setting the 'downloader.ytdl.module' value. For example { "downloader": { "ytdl": { "module": "yt_dlp" } } } or '-o module=yt_dlp'	4 years ago
Mike Fährmann	e58039358d	[mangadex] use 'api.mangadex.org' as default API server ... The caching issues seem to be gone. (#1290, #1310)	4 years ago
Mike Fährmann	29ea54dc41	[patreon] use '"browser": "firefox"' by default (#1117)	4 years ago
Mike Fährmann	61fbbd2dae	[exhentai] rename metadata fields to match API results (#1325) ... - gallery_id -> gid - gallery_token -> token - title_jp -> title_jpn - visible -> expunged - gallery_size -> filesize - count -> filecount Also changes the function of the 'metadata' option. It is now boolean and causes extra data fields from the API to be added instead of completely replacing the data from HTML when activated.	4 years ago
Mike Fährmann	5d69e437d0	[twitter] add option to download all media from a conversation ... (fixes #1319)	4 years ago
Mike Fährmann	cf5fa75d4c	add 'browser' option (#1117) ... - change default user agent to Firefox ESR 78 on Windows 10 - remove 'ciphers' option	4 years ago
Mike Fährmann	e5735361ed	[exhentai] add 'metadata' option (#1325) ... to select between gallery metadata from 'api' or 'html'	4 years ago
loragja	7b5ee922b7	cyberdrop extractor (#1328) ... * create cyberdrop extractor * add cyberdrop to list of extractors * fix formatting * change class name from CyberdropExtractor to CyberdropAlbumExtractor * add cyberdrop to list of supported sites * attempt to clean up diff of supportedsites.rst * replace regex with functions from text library	4 years ago
Mike Fährmann	5ad2b9c82b	[deviantart] extend 'extra' option ... also download from embedded DeviantArt posts	4 years ago
Mike Fährmann	560277394e	[downloader:http] add 'headers' option (#1322)	4 years ago
Mike Fährmann	6b0ecbf6bc	[hentainexus] add 'orignal' option (#1322)	4 years ago
Mike Fährmann	03b219db9d	fix supportedsites.py	4 years ago
Mike Fährmann	8974f0361c	[pixiv] update (#1304) ... - remove login with username & password - require a refresh token - add 'oauth:pixiv' functionality See also: - https://github.com/upbit/pixivpy/issues/158 - https://gist.github.com/ZipFile/c9ebedb224406f4f11845ab700124362	4 years ago
Mike Fährmann	95a66bdad6	[imgclick] add 'image' extractor (closes #1307) ... basically reverts b0e8daf415	4 years ago
Mike Fährmann	ae530f6365	[erome] add extractors for albums, users, searches (closes #409)	4 years ago
Mike Fährmann	cdb0b02e30	[pillowfort] add 'reblogs' option (#846)	4 years ago
Mike Fährmann	7ca3bf7cb0	[pillowfort] add 'user' and 'post' extractors (#846)	4 years ago
Mike Fährmann	e1bdd2ab67	add a 'generated by …' comment to supportedsites.rst	4 years ago
Mike Fährmann	0eea424a52	update supportedsites.rst	4 years ago
Federico Ravasio	25297815bc	[photovogue] added portfolio extractor (#1253)	4 years ago
Mike Fährmann	7a096c443f	[unsplash] add 'format' option (#1197)	4 years ago
v-delta	e707e060cb	[vipr] add image extractor (#1258) ... * [vipr] add image extractor Adds support for images hosted on https://vipr.im * Fix codestyle issues	4 years ago
Mike Fährmann	89a2bcbb2d	[furaffinity] add 'descriptions' option (#1231)	4 years ago