854 Commits (1317625ec42ef532759cd7dc60dc888f76279ea1)

Author	SHA1	Message	Date
Mike Fährmann	54525d2e21	[formatter] implement slice operator as format specifier ... this allows using a slice operator alongside other (special) format specifiers like J, to first join list elements to a string and then trimming that with a slice. {tags:J, /[:50]}	2 years ago
Mike Fährmann	241e82e18d	[horne] add support for horne.red (#2700)	2 years ago
Mike Fährmann	9d8e99af80	[itaku] support videos (#1842)	2 years ago
Mike Fährmann	27e8078fb7	[poipiku] add 'user' and 'post' extractors (#1602)	2 years ago
Mike Fährmann	fa902cd54d	[itaku] add 'gallery' and 'image' extractors (#1842)	2 years ago
Mike Fährmann	9c8d895d19	[twitter] implement 'csrf' option (#2676)	2 years ago
Mike Fährmann	6db77d4656	[weibo] support '?tabtype=video' listings (#2601)	2 years ago
Mike Fährmann	4b78bd423f	[paheal] add 'metadata' option (#2641)	2 years ago
Mike Fährmann	57508d3bb7	[weibo] support all different 'tabtype' listings (#686, #2601)	2 years ago
HRXN	6d0aa8c0f3	[docs/configuration.rst] Fix small typo (#2649)	2 years ago
Mike Fährmann	e0ac358aa5	[gofile] fix 401 Unauthorized errors (#2632)	2 years ago
Mike Fährmann	8a42d859bf	[bunkr] change domain to 'app.bunkr.is' (#2634)	2 years ago
Mike Fährmann	4bf5bc2403	[weibo] support 'livephoto' entries (#2146)	2 years ago
Mike Fährmann	5b43faffed	[postprocessor:metadata] write to stdout by setting filename to "-" ... (#2624)	2 years ago
Mike Fährmann	603af48265	implement 'output.ansi' option (#2628)	2 years ago
Mike Fährmann	ff5e10a86d	[hypnohub] move to gelbooru_v02 instances (#2631)	2 years ago
Mike Fährmann	d6e744bf0f	[gfycat] add 'collection' extractor (#2629)	2 years ago
Mike Fährmann	d4e9d51760	[reddit] add 'home' extractor (#2614)	2 years ago
Mike Fährmann	915dba8345	[twitter] improve results for regular user URLs ... - continuation of 3346f58a - use media timeline results (or tweet timeline if retweets are enabled) plus search results starting from the last tweet id of the first timeline, similar to how Twitter Media Downloader operates - the old behavior can be forced by appending '/tweets' to a user URL, like with '/media' (https://twitter.com/USER/tweets) although there should be no need to ever do that	2 years ago
Mike Fährmann	9df4e0f65b	[twitter] disable 'cards' by default	2 years ago
Mike Fährmann	79dce8ae68	[weasyl] implement 'metadata' option (#2610)	2 years ago
Mike Fährmann	feb470d19a	[shopifx] natively support a few more sites (closes #2089) ... - chelseacrew.com - michaels.com.au - modcloth.com - pinupgirlclothing.com - raidlondon.com (loveraid.com) - unique-vintage.com	2 years ago
Mike Fährmann	60f4d59b1e	[gelbooru_v01] remove 'tlb.booru.org' from supported domains ... 403 Forbidden nginx it is also no longer listed on https://booru.org/top	2 years ago
Mike Fährmann	6b6eb0b8f6	[lolisafe] implement 'domain' option (#2575)	2 years ago
Mike Fährmann	6742f3bc1e	implement --cookies-from-browser (#1606) ... most of the code is adapted from yt-dlp's implementation and *should* work the same.	2 years ago
Mike Fährmann	61887c895b	implement 'output.colors' options (#2532)	2 years ago
Mike Fährmann	52b47c3cf9	[gelbooru_v01] add 'favorite' extractor (#2546)	2 years ago
Mike Fährmann	84756982e9	[pixiv] implement 'include' option ... - split 'user' extractor and its 'avatar' and 'background' options into separate extractors ('artworks', 'avatar', 'background') - avatars can now be downloaded with https://www.pixiv.net/en/users/ID/avatar as URL and will use a proper archive key; similar for backgrounds - options for the 'user' subcategory must be moved to 'artworks' to have the same effect as before	2 years ago
Mike Fährmann	d11e2191ae	[nijie] support /history_nuita.php listings (closes #2541)	2 years ago
Mike Fährmann	61afa973b7	use extended format strings for archive keys	2 years ago
Federico Ravasio	0381752575	[photovogue] switch to .com, update api endpoint (#2494)	2 years ago
Mike Fährmann	9e6ff42a9d	[pixiv] implement 'background' option (#623, #1124, #2495)	2 years ago
Mike Fährmann	97e8a15295	[deviantart] implement 'pagination' option (#2488)	2 years ago
Mike Fährmann	12bd9ba33a	[readcomiconline] add 'quality' option (#2467)	2 years ago
Mike Fährmann	24ea1398bc	[postprocessor:ugoira] do not auto-select image2 demuxer (#2492)	2 years ago
Mike Fährmann	ffa1dd1d91	add 'coomer.party' to supported sites (closes #2462)	2 years ago
Mike Fährmann	9c5d2d7af3	[pinterest] add extractor for created pins (#2452)	3 years ago
Mike Fährmann	1171911dc3	[twitter] add 'syndication' option (#2354) ... to fetch age-restricted content using Twitter's syndication API	3 years ago
loragja	7e545a3ae9	[gofile] add gofile.io extractor (#2364) ... * Add gofile extractor * add gofile extractor to module list * add support for tiny monitors and ancient python versions * seriously, f-strings are not *that* new... * i love flake8 :) * add 'api-token' and 'recursive' options * add tests	3 years ago
Layerex	625f4d4cc4	[telegraph] Add telegra.ph extractor (#2312)	3 years ago
Mike Fährmann	5c2d953766	[postprocessor:ugoira] auto-select demuxer by default	3 years ago
Mike Fährmann	37d584a9b2	[hitomi] update metadata extraction (fixes #2444) ... remove 'hitomi.metadata' option, as it is no longer necessary to make additional HTTP requests to fetch all metadata.	3 years ago
Mike Fährmann	e718dd7b32	[postprocessor:ugoira] support setting timecodes with mkvmerge ... by selecting the "mkvmerge" demuxer (#1550)	3 years ago
Mike Fährmann	71bba774da	respect 'output.private' in '-K/--list-keywords' output	3 years ago
Mike Fährmann	ba69fb669d	[kemonoparty] add 'duplicates' option (closes #2440)	3 years ago
Mike Fährmann	40ce505420	[postprocessor:ugoira] add 'mtime' option (#2307)	3 years ago
Mike Fährmann	9bd27b1b8d	[postprocessor:metadata] implement archive options (#2421) ... 'archive', 'archive-format', and 'archive-prefix'	3 years ago
Mike Fährmann	f8230dde43	[instagram] add 'previews' option (#2135)	3 years ago
Mike Fährmann	cf44aba333	[formatter] allow evaluating f-string literals ... by starting a format string with '\fF'. This was technically already possible with '\fE', but this makes it a bit more convenient.	3 years ago
Mike Fährmann	58e0b17211	add note about using '\f' in shells to docs/formatting.md ... (closes #2398, closes #2406)	3 years ago
lingegrino	b3d8b40690	Rename meme.museum (#2393)	3 years ago
Mike Fährmann	fc277fa45f	[seiga] require authentication with 'user_session' cookie (#2372) ... Login with username & password would now require entering a 2FA token. see also 7b009cc893	3 years ago
Mike Fährmann	47cf05c4ab	refactor proxy handling code (#2357) ... - allow gallery-dl proxy settings to overwrite environment proxies - allow specifying different proxies for data extraction and download - add 'downloader.proxy' option - '-o extractor.proxy=–PROXY_URL -o downloader.proxy=null' now has the same effect as youtube-dl's '--geo-verification-proxy'	3 years ago
Mike Fährmann	acbb0f5a57	clarify 'metadata.mtime' usage and shortcomings (#2307)	3 years ago
Mike Fährmann	bfa5e61900	[patreon] add explicit 'image_large' file type (#2257) ... to allow more control over when and if to download 'large_url' images 4fee3a0e52 forced them to be downloaded instead of regular images, even though 'large_url' images are most likely an upscaled version of the original.	3 years ago
Alice	f1cab23724	[skeb] add 'sent-requests' option (#2322) (#2330) ... * Update skeb.py * Update configuration.rst * flake8	3 years ago
Mike Fährmann	4385a34e05	[twitter] fix handling of 429 responses (fixes #2339) ... Twitter doesn't return a valid JSON response for 429 errors anymore.	3 years ago
Mike Fährmann	5a50569360	[toyhouse] support 'art' listings (#1546, #2331)	3 years ago
Mike Fährmann	59749555b1	[postprocessor:mtime] add 'event' option (#2307)	3 years ago
Mike Fährmann	7958995398	[postprocessor:metadata] implement 'mtime' option (#2307)	3 years ago
Mike Fährmann	fdfdc1b614	[kissgoddess] add 'gallery' and 'model' extractors ... (closes #1052, #2304)	3 years ago
Mike Fährmann	79a461a2c1	[mememuseum] add 'tag' and 'post' extractors (closes #2264)	3 years ago
Mike Fährmann	254a5b26e0	[twibooru] add extractors for searches, galleries, and posts ... (#2219)	3 years ago
Mike Fährmann	f5b2a9fcc6	add 'signals-ignore' option (#2296)	3 years ago
David Hoppenbrouwers	b17e2dcf93	[wallpapercave] add extractor for images (#2205)	3 years ago
Thomas Jost	a7de819aca	[lightroom] add Lightroom gallery extractor (#2263)	3 years ago
Mike Fährmann	563bd0ecf4	[danbooru] inherit from BaseExtractor ... - merge danbooru and e621 code - support booru.allthefallen.moe (closes #2283) - remove support for old e621 tag search URLs	3 years ago
Mike Fährmann	f1c853c6ef	[furaffinity] add 'layout' option (#2277) ... to be able to force gallery-dl to parse according to a specific layout in case its auto-detect fails	3 years ago
Mike Fährmann	4e4cb40663	do not sort BaseExtractor instances by name	3 years ago
Mike Fährmann	f351746483	release version 1.20.4	3 years ago
HRXN	f4a7c6eca2	Add two examples for custom instances of gelbooru (#2262) ... * Add two examples for custom instances of gelbooru - First example uses some custom options at the "gelbooru_v01" basecategory These apply to all instances used herein - Second example adds all options to the specific "gelbooru_v02" basecategory of TBIB These settings are only used by TBIB * move tbib settings into their own block	3 years ago
Mike Fährmann	cc7dce5755	[sexcom] add 'pins' extractor (closes #2265)	3 years ago
Mike Fährmann	02e18f56be	[e621] add 'favorite' extractor (closes #2250)	3 years ago
Mike Fährmann	86fa412b47	[hitomi] add 'format' option (#2260) ... default is 'webp' since downloading original files is no longer allowed	3 years ago
Mike Fährmann	492436f936	[twitter] add 'warnings' option (#2258) ... disable reporting any non-fatal errors by default	3 years ago
Mike Fährmann	9a221494c3	[twitter] add 'event' extractor (closes #2109)	3 years ago
Mike Fährmann	de754590e0	add --source-address command-line option (closes #2206)	3 years ago
Mike Fährmann	f2e8aedd74	[twitter] changes to 'cards' option ... - change default value to 'true' - only invoke youtube-dl for cards unsupported by gallery when 'cards' is set to "ytdl" "cards": true --> only download card images "cards": "ytdl" --> download card images and use youtube_dl on otherwise unsupported cards	3 years ago
ImportTaste	c559c49781	formatting.md: add environment variable syntax (#2065)	3 years ago
Mike Fährmann	3c79c9b271	document extended blacklist/whitelist syntax (#2025) ... and not just in the commit message of 010d65dc	3 years ago
Mike Fährmann	37beb1298e	[newgrounds] add 'search' extractor (closes #2161)	3 years ago
Mike Fährmann	fa7d92f7a9	add docs for 'extractor.generic.enabled'	3 years ago
Mike Fährmann	89bebe1bef	[500px] add 'favorite' extractor (closes #1927)	3 years ago
Mike Fährmann	882c614281	add album extractor for lolisafe/chibisafe instances ... - support bunkr.is (closes #2038) - support zz.ht (closes #2105)	3 years ago
Mike Fährmann	64cf26eaf4	allow specifying sleep-* options as string ... either as single value or as range: "3.5", "2.1 - 5.0"	3 years ago
Mike Fährmann	62692c6842	[exhentai] add 'source' option ... setting it to "hitomi" downloads the corresponding gallery from hitomi.la; might be extended to other sources in the future	3 years ago
Mike Fährmann	099ed72de7	[hitomi] disable extra 'metadata' by default ... safes one HTTP request that not needed with default filename settings	3 years ago
Mike Fährmann	f587458a3c	[twitter] include '4096x4096' as a default image fallback ... (closes #2107, closes #1881)	3 years ago
Mike Fährmann	299bd2f1f5	[rule34us] add 'tag' and 'post' extractors (#1527)	3 years ago
Mike Fährmann	3cf1075d86	[inkbunny] add 'search' extractor (closes #2094)	3 years ago
Mike Fährmann	f4e3cee6ac	use yt-dlp by default (#1850, #2028)	3 years ago
Mike Fährmann	f1b142e993	{kemonoparty[ change default 'files' order to attachments,file,inline ... (#1991)	3 years ago
Mike Fährmann	addb72e1bb	[reactor] support thatpervert.com (closes #2029)	3 years ago
Mike Fährmann	d8d9502e1e	[reactor] inherit from BaseExtractor	3 years ago
Mike Fährmann	f4ea216c95	[shopify] support loungeunderwear.com (closes #2053)	3 years ago
Alice	612850438e	[skeb] add 'thumbnails' option (#2047) (#2051)	3 years ago
Mike Fährmann	11a3d96d13	[mangadex] load additional metadata using includes[] directives ... - always provide 'artist', 'author', and 'group' metadata fields (#2049) - remove 'metadata' option	3 years ago
Mike Fährmann	c67756e187	[kemonoparty] add 'dms' option (#2008)	3 years ago
Mike Fährmann	3842cdcd8f	[formatter] implement 'D' format specifier ... To be able to parse any string into a 'datetime' object and format it as necessary. Example: {created_at:D%Y-%m-%dT%H:%M:%S%z} -> "2010-01-01 00:00:00" {created_at:D%Y-%m-%dT%H:%M:%S%z/%b %d %Y %I:%M %p} -> "Jan 01 2010 12:00 AM" with 'created_at' == "2010-01-01T01:00:00+0100"	3 years ago
Mike Fährmann	3a7a19c7b9	[dynastyscans] add 'manga' extractor (closes #2035)	3 years ago
Mike Fährmann	9bc83af3a6	[kemonoparty] 'postfile' -> 'file' (#1991) ... to stay consistent with the existing file types for kemono	3 years ago
Mike Fährmann	d433735750	[kemonoparty] skip duplicate files (#2032, #1991, #1899) ... Extract the SHA-256 file hash from URLs and skip files with the same hash in the same post. - provide a 'hash' metadata field (empty string if not available) - remove 'patreon-skip-file' option	3 years ago
Mike Fährmann	d4ec245554	[kemonoparty] implement a 'files' option (#1991) ... similar to 8d676151	3 years ago
Mike Fährmann	cfa4876848	[philomena] support furbooru.org (closes #1995)	3 years ago
Mike Fährmann	7c50f473e4	[ytdl] document 'cmdline-args' and 'config-file' options (#1680)	3 years ago
Mike Fährmann	37c9dedee1	[seisoparty] remove module	3 years ago
Mike Fährmann	b315a0ecef	[redgifs] update to API v2 (#1984)	3 years ago
Mike Fährmann	f0fc3b0ba1	[kemonoparty] add 'comments' option (#1980)	3 years ago
Mike Fährmann	4c49174579	[mangakakalot] update domain and fix extraction	3 years ago
ImportTaste	69cd573809	add special type format strings to docs (#1987)	3 years ago
Mike Fährmann	9156e90f1f	[twitter] add 'pinned' option	3 years ago
Mike Fährmann	06b414c9a3	[redgifs] 'gfyId' -> 'id' (#1984)	3 years ago
Alice	bfd7401b1e	[skeb] add 'user' and 'post' extractors (#1031) (#1971) ... * Create skeb.py * Update __init__.py * Update supportedsites.py * Update supportedsites.md * Update supportedsites.py * Update skeb.py	3 years ago
Mike Fährmann	02a247f4e5	[deviantart] full resolution for non-downloadable images (#293) ... Many thanks to @Ironchest337 for discovering this method and providing a well-documented implementation.	3 years ago
Mike Fährmann	c19e762fdf	[vk] add 'album' extractor (#474, fixes #1952) ... todo: better metadata for albums	3 years ago
Mike Fährmann	8bb442f20d	[redgifs][gfycat] provide fallback URLs (fixes #1962) ... and extend the 'format' option	3 years ago
Mike Fährmann	8d676151b7	[patreon] implement 'files' option (#1935)	3 years ago
Mike Fährmann	80314e981b	small corrections to gallery-dl-example.conf ... use "'_reddit' in locals()" instead of ""locals().get('_reddit')" since the reddit metadata dict could be empty. The latter expression would evaluate to False in that case, even though it has a reddit parent.	3 years ago
Mike Fährmann	3ecf4a9729	update gallery-dl-example.conf ... - add comments - remove/replace some older options - display more post processor settings	3 years ago
Mike Fährmann	50098762e3	[nhentai] add 'tag' extractor (closes #1950)	3 years ago
Mike Fährmann	fe6ce5495a	[kemonoparty] add 'discord' extractor (#1827, #1940)	3 years ago
Mike Fährmann	918fc9974d	[picarto] add 'gallery' extractor (closes #1931)	3 years ago
Mike Fährmann	e33125ad39	[pixiv] add 'sketch' extractor (#1497)	3 years ago
Mike Fährmann	b93915c113	[inkbunny] add 'pool' extractor (#1937)	3 years ago
Mike Fährmann	373d3e1c57	[seisoparty] implement login with username & password (#1906)	3 years ago
Mike Fährmann	7c5f62b453	[seisoparty] add 'favorite' extractor (#1906)	3 years ago
Mike Fährmann	d93b5474c3	[mangadex] update parameter handling for API requests ... - move common parameters into '_pagination()' - add 'ratings' (#1908) and 'api-parameters' options	3 years ago
Mike Fährmann	cd66c3c415	[twitter] add 'size' option (#1881)	3 years ago
Mike Fährmann	df8050b81d	[postprocessor:compare] add 'equal' option (#1592) ... Move functionality from cdd72e14 to its own option, where it can be used with any 'action'	3 years ago
Mike Fährmann	cdd72e1413	[postprocessor:compare] extend 'action' option (#1592) ... allow setting it to "abort", "terminate", or "exit" as with 'skip'	3 years ago
Mike Fährmann	e0bdacd932	[fappic] add 'image' extractor (closes #1898)	3 years ago
Mike Fährmann	8c29a6e491	add example for 'url-metadata' option (closes #1884)	3 years ago
Mike Fährmann	d0761454b1	implement a download progress indicator (#1519)	3 years ago
Mike Fährmann	140a7bfdcd	update --clear-cache command in deviantart client-id instructions	3 years ago
Mike Fährmann	e69ee41f25	implement 'page-reverse' option (#1854)	3 years ago
Mike Fährmann	e4684c5cb9	[desktopography] simplify (#1740)	3 years ago
Mike Fährmann	7b05600056	[pinterest] only mention cookies for authentication (#1856) ... regular login is broken due to CAPTCHA	3 years ago
Mike Fährmann	266ed9b62e	[aryion] add 'tag' extractor (closes #1849)	3 years ago
Mike Fährmann	c9e6693530	allow specifying a minimum/maximum for 'sleep-*' options (#1835) ... for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10 seconds between each HTTP request	3 years ago
Mike Fährmann	bd845303ad	implement a way to shorten filenames with east-asian characters ... (#1377) Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower algorithm that also considers characters with a width > 1.	3 years ago
Mike Fährmann	7bbb1f92d7	[gelbooru_v02] add 'favorite' extractor (closes #1834)	3 years ago
Mike Fährmann	4ec11af6a4	[kemonoparty] implement login with username & password (#1824)	3 years ago
Mike Fährmann	83bbb628d8	[kemonoparty] add 'favorite' extractor (#1824)	3 years ago
Mike Fährmann	44f572c27f	[deviantart] implement a 'auto-unwatch' option (#1466, #1757)	3 years ago
Mike Fährmann	268c9ca034	update default gallery-dl.conf	3 years ago
Mike Fährmann	3e36543c98	[nhentai] add 'favorite' extractor (#1814)	3 years ago
Mike Fährmann	96fec14ef7	[deviantart] rename 'watch' option to 'auto-watch' ... (#1466, #1757) Similar reason as in e05a96db. 'watch' is already used by the WatchExtractor class.	3 years ago
Mike Fährmann	e75f2de9da	[deviantart] add 'comments' option (#1800)	3 years ago
Mike Fährmann	6ce16c6d31	[deviantart] add 'tag' extractor (closes #1803)	3 years ago
Mike Fährmann	4e9f8fe395	[shopify] support windsorstore.com (#1793)	3 years ago