516 Commits (8cf13f8696e6bee8fbb0263332ea1596fc8ac479)

Author	SHA1	Message	Date
Mike Fährmann	e99a9b2aff	[twitter] improve 'cards-blacklist' (#2875) ... allow blacklisting domains and 'name:domain', where 'domain' depends on a card's 'vanity_url' value	2 years ago
Mike Fährmann	46fe469c53	[tumblr] implement 'ratelimit' option (#2919)	2 years ago
Mike Fährmann	b36125333f	[postprocessor:zip] implement 'files' option (#2872)	2 years ago
Mike Fährmann	3cb8327c60	[zerochan] add 'metadata' option (#2861)	2 years ago
blankie	9745b48830	[tumblr] attempt to fetch high-quality inline images (#2877) ... * [tumblr] attempt to fetch high-quality images (again) Fixes #1846, and fixes #1344 * slight refactor * update configuration.rst entry	2 years ago
Mike Fährmann	4d78ca89db	[twitter] add 'cards-blacklist' option (#2875)	2 years ago
Mike Fährmann	f16fbe9f93	document 'extractor.twitter.expand' (#2848)	2 years ago
enduser420	574e38a287	[kemonoparty] add 'favorites' option (#2826) (#2831) ... * [kemonoparty] add 'favorites' option (#2826) * [kemonoparty] add regex for the url parameter and fallback on the config option * [kemonoparty] simplify	2 years ago
Martin Juhasz	9ea521bec5	[oauth] add host config option (#2806)	2 years ago
Mike Fährmann	df1c643dda	[tumblr] attempt to extract full-resolution photos ... - for photos with apparent width == 2048 or height == 3072 - can be disabled with 'original' option	2 years ago
Mike Fährmann	a69f198ac9	[wallhaven] implement 'metadata' option (#2803)	2 years ago
Mike Fährmann	7d1a95ada6	implement 'path-metadata' option (#2734)	2 years ago
Mike Fährmann	8cf5981ded	[skeb] add option to download 'article' images (#1031)	2 years ago
Mike Fährmann	98af5a0409	[zerochan] implement login with username & password (#1434)	2 years ago
Mike Fährmann	0c73914848	[postprocessor:metadata] implement 'mode: modify' (#2640)	2 years ago
Mike Fährmann	f3de6b7a87	[postprocessor:metadata] implement 'mode: delete' (#2640)	2 years ago
Mike Fährmann	eb68d45544	add global 'warnings' option (#2762)	2 years ago
Mike Fährmann	f225247670	[gelbooru] add support for `api_key` and `user_id` (#2767)	2 years ago
Mike Fährmann	74865adae5	implement 'format-separator' option (#2737) ... a global option, that servers as a workaround for shortcomings due to lack of a proper format string parser	2 years ago
bradenhilton	117eeefda0	[postprocessor:mtime] add 'value' option (#2739)	2 years ago
Mike Fährmann	1d14928bd9	[twitter] ignore previously seen Tweets (#2712) ... occurs primarily for /with_replies results when logged in	2 years ago
Mike Fährmann	4b2a0a0eda	[twitter] implement 'strategy' option (#2712) ... to be able to better control what Tweets get used an returned for twitter.com/USER URLs.	2 years ago
Mike Fährmann	124b5c6410	[postprocessor:ugoira] enable 'mtime' by default (#2714)	2 years ago
Mike Fährmann	3a5d5c3a91	update default User-Agent header to Firefox 102 ESR ... snd update headers and ciphers for "browser": "firefox"	2 years ago
Mike Fährmann	9d8e99af80	[itaku] support videos (#1842)	2 years ago
Mike Fährmann	9c8d895d19	[twitter] implement 'csrf' option (#2676)	2 years ago
Mike Fährmann	6db77d4656	[weibo] support '?tabtype=video' listings (#2601)	2 years ago
Mike Fährmann	4b78bd423f	[paheal] add 'metadata' option (#2641)	2 years ago
Mike Fährmann	57508d3bb7	[weibo] support all different 'tabtype' listings (#686, #2601)	2 years ago
HRXN	6d0aa8c0f3	[docs/configuration.rst] Fix small typo (#2649)	2 years ago
Mike Fährmann	e0ac358aa5	[gofile] fix 401 Unauthorized errors (#2632)	2 years ago
Mike Fährmann	4bf5bc2403	[weibo] support 'livephoto' entries (#2146)	2 years ago
Mike Fährmann	5b43faffed	[postprocessor:metadata] write to stdout by setting filename to "-" ... (#2624)	2 years ago
Mike Fährmann	603af48265	implement 'output.ansi' option (#2628)	2 years ago
Mike Fährmann	915dba8345	[twitter] improve results for regular user URLs ... - continuation of 3346f58a - use media timeline results (or tweet timeline if retweets are enabled) plus search results starting from the last tweet id of the first timeline, similar to how Twitter Media Downloader operates - the old behavior can be forced by appending '/tweets' to a user URL, like with '/media' (https://twitter.com/USER/tweets) although there should be no need to ever do that	2 years ago
Mike Fährmann	9df4e0f65b	[twitter] disable 'cards' by default	2 years ago
Mike Fährmann	79dce8ae68	[weasyl] implement 'metadata' option (#2610)	2 years ago
Mike Fährmann	6b6eb0b8f6	[lolisafe] implement 'domain' option (#2575)	2 years ago
Mike Fährmann	6742f3bc1e	implement --cookies-from-browser (#1606) ... most of the code is adapted from yt-dlp's implementation and *should* work the same.	2 years ago
Mike Fährmann	61887c895b	implement 'output.colors' options (#2532)	2 years ago
Mike Fährmann	84756982e9	[pixiv] implement 'include' option ... - split 'user' extractor and its 'avatar' and 'background' options into separate extractors ('artworks', 'avatar', 'background') - avatars can now be downloaded with https://www.pixiv.net/en/users/ID/avatar as URL and will use a proper archive key; similar for backgrounds - options for the 'user' subcategory must be moved to 'artworks' to have the same effect as before	2 years ago
Mike Fährmann	d11e2191ae	[nijie] support /history_nuita.php listings (closes #2541)	2 years ago
Mike Fährmann	61afa973b7	use extended format strings for archive keys	2 years ago
Mike Fährmann	9e6ff42a9d	[pixiv] implement 'background' option (#623, #1124, #2495)	2 years ago
Mike Fährmann	97e8a15295	[deviantart] implement 'pagination' option (#2488)	2 years ago
Mike Fährmann	12bd9ba33a	[readcomiconline] add 'quality' option (#2467)	2 years ago
Mike Fährmann	24ea1398bc	[postprocessor:ugoira] do not auto-select image2 demuxer (#2492)	2 years ago
Mike Fährmann	1171911dc3	[twitter] add 'syndication' option (#2354) ... to fetch age-restricted content using Twitter's syndication API	3 years ago
loragja	7e545a3ae9	[gofile] add gofile.io extractor (#2364) ... * Add gofile extractor * add gofile extractor to module list * add support for tiny monitors and ancient python versions * seriously, f-strings are not *that* new... * i love flake8 :) * add 'api-token' and 'recursive' options * add tests	3 years ago
Mike Fährmann	5c2d953766	[postprocessor:ugoira] auto-select demuxer by default	3 years ago
Mike Fährmann	37d584a9b2	[hitomi] update metadata extraction (fixes #2444) ... remove 'hitomi.metadata' option, as it is no longer necessary to make additional HTTP requests to fetch all metadata.	3 years ago
Mike Fährmann	e718dd7b32	[postprocessor:ugoira] support setting timecodes with mkvmerge ... by selecting the "mkvmerge" demuxer (#1550)	3 years ago
Mike Fährmann	71bba774da	respect 'output.private' in '-K/--list-keywords' output	3 years ago
Mike Fährmann	ba69fb669d	[kemonoparty] add 'duplicates' option (closes #2440)	3 years ago
Mike Fährmann	40ce505420	[postprocessor:ugoira] add 'mtime' option (#2307)	3 years ago
Mike Fährmann	9bd27b1b8d	[postprocessor:metadata] implement archive options (#2421) ... 'archive', 'archive-format', and 'archive-prefix'	3 years ago
Mike Fährmann	f8230dde43	[instagram] add 'previews' option (#2135)	3 years ago
Mike Fährmann	fc277fa45f	[seiga] require authentication with 'user_session' cookie (#2372) ... Login with username & password would now require entering a 2FA token. see also 7b009cc893	3 years ago
Mike Fährmann	47cf05c4ab	refactor proxy handling code (#2357) ... - allow gallery-dl proxy settings to overwrite environment proxies - allow specifying different proxies for data extraction and download - add 'downloader.proxy' option - '-o extractor.proxy=–PROXY_URL -o downloader.proxy=null' now has the same effect as youtube-dl's '--geo-verification-proxy'	3 years ago
Mike Fährmann	acbb0f5a57	clarify 'metadata.mtime' usage and shortcomings (#2307)	3 years ago
Mike Fährmann	bfa5e61900	[patreon] add explicit 'image_large' file type (#2257) ... to allow more control over when and if to download 'large_url' images 4fee3a0e52 forced them to be downloaded instead of regular images, even though 'large_url' images are most likely an upscaled version of the original.	3 years ago
Alice	f1cab23724	[skeb] add 'sent-requests' option (#2322) (#2330) ... * Update skeb.py * Update configuration.rst * flake8	3 years ago
Mike Fährmann	4385a34e05	[twitter] fix handling of 429 responses (fixes #2339) ... Twitter doesn't return a valid JSON response for 429 errors anymore.	3 years ago
Mike Fährmann	59749555b1	[postprocessor:mtime] add 'event' option (#2307)	3 years ago
Mike Fährmann	7958995398	[postprocessor:metadata] implement 'mtime' option (#2307)	3 years ago
Mike Fährmann	254a5b26e0	[twibooru] add extractors for searches, galleries, and posts ... (#2219)	3 years ago
Mike Fährmann	f5b2a9fcc6	add 'signals-ignore' option (#2296)	3 years ago
Mike Fährmann	f1c853c6ef	[furaffinity] add 'layout' option (#2277) ... to be able to force gallery-dl to parse according to a specific layout in case its auto-detect fails	3 years ago
Mike Fährmann	86fa412b47	[hitomi] add 'format' option (#2260) ... default is 'webp' since downloading original files is no longer allowed	3 years ago
Mike Fährmann	492436f936	[twitter] add 'warnings' option (#2258) ... disable reporting any non-fatal errors by default	3 years ago
Mike Fährmann	de754590e0	add --source-address command-line option (closes #2206)	3 years ago
Mike Fährmann	f2e8aedd74	[twitter] changes to 'cards' option ... - change default value to 'true' - only invoke youtube-dl for cards unsupported by gallery when 'cards' is set to "ytdl" "cards": true --> only download card images "cards": "ytdl" --> download card images and use youtube_dl on otherwise unsupported cards	3 years ago
Mike Fährmann	3c79c9b271	document extended blacklist/whitelist syntax (#2025) ... and not just in the commit message of 010d65dc	3 years ago
Mike Fährmann	fa7d92f7a9	add docs for 'extractor.generic.enabled'	3 years ago
Mike Fährmann	64cf26eaf4	allow specifying sleep-* options as string ... either as single value or as range: "3.5", "2.1 - 5.0"	3 years ago
Mike Fährmann	62692c6842	[exhentai] add 'source' option ... setting it to "hitomi" downloads the corresponding gallery from hitomi.la; might be extended to other sources in the future	3 years ago
Mike Fährmann	099ed72de7	[hitomi] disable extra 'metadata' by default ... safes one HTTP request that not needed with default filename settings	3 years ago
Mike Fährmann	f587458a3c	[twitter] include '4096x4096' as a default image fallback ... (closes #2107, closes #1881)	3 years ago
Mike Fährmann	f4e3cee6ac	use yt-dlp by default (#1850, #2028)	3 years ago
Mike Fährmann	f1b142e993	{kemonoparty[ change default 'files' order to attachments,file,inline ... (#1991)	3 years ago
Alice	612850438e	[skeb] add 'thumbnails' option (#2047) (#2051)	3 years ago
Mike Fährmann	11a3d96d13	[mangadex] load additional metadata using includes[] directives ... - always provide 'artist', 'author', and 'group' metadata fields (#2049) - remove 'metadata' option	3 years ago
Mike Fährmann	c67756e187	[kemonoparty] add 'dms' option (#2008)	3 years ago
Mike Fährmann	9bc83af3a6	[kemonoparty] 'postfile' -> 'file' (#1991) ... to stay consistent with the existing file types for kemono	3 years ago
Mike Fährmann	d433735750	[kemonoparty] skip duplicate files (#2032, #1991, #1899) ... Extract the SHA-256 file hash from URLs and skip files with the same hash in the same post. - provide a 'hash' metadata field (empty string if not available) - remove 'patreon-skip-file' option	3 years ago
Mike Fährmann	d4ec245554	[kemonoparty] implement a 'files' option (#1991) ... similar to 8d676151	3 years ago
Mike Fährmann	7c50f473e4	[ytdl] document 'cmdline-args' and 'config-file' options (#1680)	3 years ago
Mike Fährmann	b315a0ecef	[redgifs] update to API v2 (#1984)	3 years ago
Mike Fährmann	f0fc3b0ba1	[kemonoparty] add 'comments' option (#1980)	3 years ago
Mike Fährmann	9156e90f1f	[twitter] add 'pinned' option	3 years ago
Mike Fährmann	06b414c9a3	[redgifs] 'gfyId' -> 'id' (#1984)	3 years ago
Mike Fährmann	02a247f4e5	[deviantart] full resolution for non-downloadable images (#293) ... Many thanks to @Ironchest337 for discovering this method and providing a well-documented implementation.	3 years ago
Mike Fährmann	8bb442f20d	[redgifs][gfycat] provide fallback URLs (fixes #1962) ... and extend the 'format' option	3 years ago
Mike Fährmann	8d676151b7	[patreon] implement 'files' option (#1935)	3 years ago
Mike Fährmann	373d3e1c57	[seisoparty] implement login with username & password (#1906)	3 years ago
Mike Fährmann	d93b5474c3	[mangadex] update parameter handling for API requests ... - move common parameters into '_pagination()' - add 'ratings' (#1908) and 'api-parameters' options	3 years ago
Mike Fährmann	cd66c3c415	[twitter] add 'size' option (#1881)	3 years ago
Mike Fährmann	df8050b81d	[postprocessor:compare] add 'equal' option (#1592) ... Move functionality from cdd72e14 to its own option, where it can be used with any 'action'	3 years ago
Mike Fährmann	cdd72e1413	[postprocessor:compare] extend 'action' option (#1592) ... allow setting it to "abort", "terminate", or "exit" as with 'skip'	3 years ago
Mike Fährmann	8c29a6e491	add example for 'url-metadata' option (closes #1884)	3 years ago
Mike Fährmann	d0761454b1	implement a download progress indicator (#1519)	3 years ago
Mike Fährmann	140a7bfdcd	update --clear-cache command in deviantart client-id instructions	3 years ago
Mike Fährmann	e69ee41f25	implement 'page-reverse' option (#1854)	3 years ago
Mike Fährmann	7b05600056	[pinterest] only mention cookies for authentication (#1856) ... regular login is broken due to CAPTCHA	3 years ago
Mike Fährmann	c9e6693530	allow specifying a minimum/maximum for 'sleep-*' options (#1835) ... for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10 seconds between each HTTP request	3 years ago
Mike Fährmann	bd845303ad	implement a way to shorten filenames with east-asian characters ... (#1377) Setting 'output.shorten' to "eaw" (East-Asian Width) uses a slower algorithm that also considers characters with a width > 1.	3 years ago
Mike Fährmann	4ec11af6a4	[kemonoparty] implement login with username & password (#1824)	3 years ago
Mike Fährmann	44f572c27f	[deviantart] implement a 'auto-unwatch' option (#1466, #1757)	3 years ago
Mike Fährmann	96fec14ef7	[deviantart] rename 'watch' option to 'auto-watch' ... (#1466, #1757) Similar reason as in e05a96db. 'watch' is already used by the WatchExtractor class.	3 years ago
Mike Fährmann	e75f2de9da	[deviantart] add 'comments' option (#1800)	3 years ago
Mike Fährmann	ecc8da4704	[deviantart] implement a 'watch' option (#1466, #1757)	3 years ago
Mike Fährmann	d3eab417ed	implement a 'path-strip' option	3 years ago
Mike Fährmann	d320ee6251	implement a 'fallback' option (closes #1770)	3 years ago
Mike Fährmann	c866fcba48	[twitter] fix 'logout' (#1719) ... delete 'auth_token' cookie and cookies.txt path	3 years ago
Mike Fährmann	ed4b3c48cb	fix flake8 and other tests	3 years ago
Nyasume	fa6af46756	Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701)	3 years ago
Mike Fährmann	e5a93e113f	[twitter] extend 'replies' option (#1254) ... Allow setting 'replies to '"self"' to only download from self-replies.	3 years ago
Mike Fährmann	cadfad4eea	[danbooru] add 'external' option (closes #1747)	3 years ago
Mike Fährmann	5b1c62bfa9	[furaffinity] add 'external' option (closes #1492)	3 years ago
Mike Fährmann	a316e44f8e	[bbc] add 'width' option (#1706)	3 years ago
Mike Fährmann	7a0da4f93f	[newgrounds] add 'format' option (closes #1729)	3 years ago
Mike Fährmann	486474800f	[kemonoparty] skip duplicated patreon files (closes #1689) ... this behavior can be disabled with the 'patreon-skip-file' option	3 years ago
Mike Fährmann	13d4045a8a	add 'archive-prefix' option (#1711)	3 years ago
Mike Fährmann	b9783403d9	add 'url-metadata' option (#1659, #1073)	3 years ago
Mike Fährmann	e95f99882f	extend 'parent-metadata' functionality (#1687, #1651, #1364)	3 years ago
Mike Fährmann	dff0da60f9	[ytdl] add 'generic' option (#1680)	3 years ago
Mike Fährmann	36ac2197db	[ytdl] add extractor for sites supported by youtube-dl ... (#1680, #878) Can be used by prefixing any URL with 'ytdl:', or by setting 'extractor,ytdl.enabled' to 'true'.	3 years ago
Mike Fährmann	8b036778e3	[kemonoparty] add 'max-posts' option (#1674)	3 years ago
Mike Fährmann	312a28e78a	[mastodon] add 'replies' option (#1669)	3 years ago
Mike Fährmann	a1f5b78039	[mastodon] add 'reblogs' option (#1669)	3 years ago
Mike Fährmann	93d356712c	[mastodon] implement 'text-posts' option (#1569) ... similar to Twitter's 'text-tweets'	3 years ago
Mike Fährmann	963d177a68	document format string syntax ... or at least attempt to	3 years ago
Mike Fährmann	e661607e8b	[mangadex] document 'metadata' and 'lang' options (#1535)	3 years ago
Mike Fährmann	fd00d47116	implement conditional directories (#1394) ... They work the same way as conditional filenames (84d2e640), e.g. "directory": { "score >= 20": ["high score"], "score >= 5" : ["mid score"], "" : ["{category}", "default"] }	3 years ago
Mike Fährmann	a751afdfb3	[twitter] change some defaults ... - 'retweets' option: true -> false - 'quoted' option : true -> false i.e. disable downloading tweets from other user's timelines by default - search directory: '["{category}", "Search", "{search}"]' -> '["{category}", "{user[name]}"]' i.e. change it to the same as other twitter extractors (#1308)	3 years ago
Mike Fährmann	84d2e64024	combine conditional filenames into `filename` option (#1394)	3 years ago
Mike Fährmann	07c8adbd8b	[mangadex] implement login with username & password (#1535)	3 years ago
Mike Fährmann	3cbbefd4ed	support 'filter' option for post processors (#1460)	3 years ago
Mike Fährmann	4cf40434d7	initial support for conditional filenames (#1394)	3 years ago
Mike Fährmann	f3d692a378	improve docs for danbooru and e621 passwords (#1593, #1596)	3 years ago
Mike Fährmann	c80b18a477	[weibo] extend 'retweets' option (closes #1542) ... Setting 'retweets' to "original" will use metadata from the original posts, and not from the retweeted ones.	3 years ago
Mike Fährmann	74d97e6c6b	[postprocessor:ugoira] add 'repeat-last-frame' option (#1550)	3 years ago
Mike Fährmann	be9547a5f3	[postprocessor:ugoira] use 'image2' demuxer (#1550) ... Ensures exact frame timecodes with no duplicate frames. Possible issues are the duration the last frame in an Ugoira with variable frame durations is shown and insufficient timestamp precision of the underlying file system (e.g. FAT32, ext3; works on ext4, tmpfs, NTFS).	3 years ago
Mike Fährmann	b8de0671e5	update description for 'instagram.include' ... - add double quotes for "reels" - add "tagged"	3 years ago
thatfuckingbird	e6811c7450	[pixiv] implement 'max-posts' option (#1558) ... * implement max-rank for pixiv * rename to max-posts and make more generic	3 years ago
Mike Fährmann	b5affc62aa	[twitter] rename 'text-only' to 'text-tweets' (#570)	3 years ago
Mike Fährmann	724ca61f36	[twitter] add 'text-only' option (#570)	3 years ago
Mike Fährmann	1eabfa5c7a	[pillowfort] implement login with username & password (#846)	3 years ago
Mike Fährmann	a7e4917ee1	[pillowfort] add 'inline' option (#846) ... to support images present in a post's 'content', but not listed in 'media'. also separates the file hash present at the beginning of each 'filename' into its own field.	3 years ago
Mike Fährmann	efa6cc8ec3	[pillowfort] add 'external' option (#846) ... for links to external Twitter posts etc.	3 years ago