568 Commits (ceaf7fd9893d85157c2a798e71d2cd8a0c0da6b6)

Author	SHA1	Message	Date
Mike Fährmann	89a2bcbb2d	[furaffinity] add 'descriptions' option (#1231)	4 years ago
Mike Fährmann	36f281330a	[newgrounds] fix flash file extraction (closes #1257) ... … and add a 'flash' option to choose between flash and video formats.	4 years ago
Mike Fährmann	534194bf92	[unsplash] add extractors (#1197) ... for - single photos (/photos/ID) - user profiles (/@USER) - user likes (/@USER/likes) - search results (/s/photos/SEARCH)	4 years ago
Mike Fährmann	c008cb5100	[pixiv] add 'related' option (#1237)	4 years ago
Mike Fährmann	01b9ccd4de	[derpibooru] use the "Everything" filter by default (#1243) ... when neither 'api-key' nor 'filter' are set	4 years ago
Mike Fährmann	5d4494b15f	add "ascii" as a special 'path-restrict' value	4 years ago
Mike Fährmann	20bd9cd296	[wikiart] add extractor for single paintings (closes #1233) ... There is no API endpoint for single paintings from what I can tell, so this uses the site's search.	4 years ago
Mike Fährmann	fa8ee6eac4	[derpibooru] add search and gallery extractors (#862)	4 years ago
Mike Fährmann	8a88025dc4	[pinterest] support generic user URLs (#1205) ... i.e. https://www.pinterest.com/USERNAME also renames 'BoardsExtractor' to 'UserExtractor'	4 years ago
Mike Fährmann	56b460dcea	[foolfuuka] add 'search' extractors (#1174)	4 years ago
Mike Fährmann	fb64183d53	[foolfuuka] add 'board' extractors (closes #1044)	4 years ago
Mike Fährmann	b0beed7a06	[sankaku] add support for book searches (closes #1204)	4 years ago
Mike Fährmann	459a0af4f8	[sankaku] add support for sankaku.app URLs (closes #1193)	4 years ago
Mike Fährmann	371e9ca6df	[pinterest] implement video support (closes #1189)	4 years ago
Mike Fährmann	bf629a2818	[instagram] add 'include' option (closes #1180) ... Split the functionality of the old 'user' extractor into separate 'posts' and 'highlights' extractors, which respond to virtual URLs ('/<user>/posts' and '/<user>/highlights')	4 years ago
Mike Fährmann	212ae0c399	[mangapanda] remove module ... site now redirects to mangareader.net	4 years ago
Mike Fährmann	465015f75a	[sankaku] reimplement login support (#1176, #1182)	4 years ago
Mike Fährmann	b2c55f0a72	[sankaku] remove login support ... The old login method for 'https://chan.sankakucomplex.com/user/login' and the cookies it produces have no effect on the results from 'beta.sankakucomplex.com'.	4 years ago
Mike Fährmann	cc15fbe71a	[moebooru] add generalized extractors for moebooru sites ... - add support for sakugabooru.com (closes #1136) - add support for lolibooru.moe (closes #1050) This allows users to dynamically add support for moebooru/myimouto based sites by adding an entry to their config file (like for foolslide, foolfuuka, etc) For example: { "extractor": { "moebooru": { "new-site-1": {"root": "https://site1.net"}, "new-site-2": {"root": "https://www.site2.moe"} } } }	4 years ago
Mike Fährmann	0bc492c0fa	add docs for 'event' and 'filename' options ... from 9c3568c3 and ca59bd69	4 years ago
Mike Fährmann	9b1bd09454	change 'extension-map' default ... Replace all JPEG filename extensions with 'jpg'.	4 years ago
Mike Fährmann	de0c57886d	[twitter] add 'list-members' extractor (closes #1096)	4 years ago
Mike Fährmann	bc7b1d91bc	fix rST markup in configuration.rst ... [ci skip]	4 years ago
Mike Fährmann	e3480bc8de	implement 'extension-map' option (#318)	4 years ago
Mike Fährmann	98a4d86a01	[sankakucomplex] extract videos and embeds (closes #308)	4 years ago
Mike Fährmann	d83b95fd28	[postprocessor:metadata] accept a string-list for 'content-format' ... (closes #1080)	4 years ago
Mike Fährmann	5bcf28de93	add a 'extractor.modules' option	4 years ago
Mike Fährmann	18213dc5ba	release version 1.15.2	4 years ago
Mike Fährmann	1686dc1757	[twitter] support media from Cards (#1005, #937) ... Can be enabled with 'extractor.twitter.cards', but for now disabled by default because cards can redirect to rather large videos from YouTube or Twitch.	4 years ago
Mike Fährmann	bac8af69e8	update configuration.rst ... - add some lines to better explain post processor usage - syntax highlighting for JSON blocks and other smaller stuff	4 years ago
Mike Fährmann	05d7009cc6	rename 'Authentication' entries in supportedsites.rst ... - change 'Optional' to 'Supported' - use 'OAuth' and 'Cookies' in their own - add link to weasyl API key option	4 years ago
Mike Fährmann	d1c6d78477	fix rST markup in configuration.rst	4 years ago
Mike Fährmann	b8daabc3ca	[pinterest] implement login support (closes #1055) ... being logged allows access to secret/protected boards	4 years ago
Zanny	3ec60e894a	[weasyl] api-key authentication (#1057) ... * [weasyl] support api keys * [weasyl] document api-key authentication * [weasyl] usernames can contain ~	4 years ago
Mike Fährmann	35056a07d1	release version 1.15.1	4 years ago
Mike Fährmann	dd1e545597	[hentaifoundry] rename GalleryExtractor to PicturesExtractor	4 years ago
Mike Fährmann	c874071f5a	[kissmanga] remove module	4 years ago
Mike Fährmann	430b6d6e2e	[twitter] extend 'retweets' option (closes #1026) ... Setting 'retweets' to '"original"' will use metadata from the original retweeted Tweets, and not from the Retweet entry.	4 years ago
Mike Fährmann	b9bdd2c564	[hentaifoundry] add support for stories (closes #734)	4 years ago
Mike Fährmann	117582d798	use definition lists instead of tables in docs/configuration.rst ... and strip some clutter from generated man pages	4 years ago
Mike Fährmann	cc4ac80302	[weasyl] add 'favorite' extractor (#1032)	4 years ago
Mike Fährmann	e9cc719497	[weasyl] update and simplify ... - simplify 'pattern' regexps - parse 'posted_at' as 'date' - use unaltered 'title' ({title!l:R /_/} to lowercase and replace spaces)	4 years ago
Mike Fährmann	6514312126	[nijie] add 'include' option (closes #1018)	4 years ago
Mike Fährmann	0d43456323	[hentaifoundry] add 'include' option	4 years ago
Zanny	ebb7737b9b	Weasyl Extractor (#977) ... * weasyl extractor * @kattjevfel suggested changes * @mikf changes	4 years ago
Mike Fährmann	1e313d5b84	implement 'sleep-request' option	4 years ago
Mike Fährmann	c43b3894be	[myhentaigallery] update and fix extraction (#1001) ... - extract more metadata - match "/show/" URLs - complete test results - fix missing images for lines starting with " <img" - fix missing comma in supportedsites.py	4 years ago
Mike Fährmann	6a5f6396d4	add clearing cache to dA client-id instructions (#996)	4 years ago
Mike Fährmann	3afd362e2e	add 'sleep-extractor' option (closes #964) ... (would have been nice if this were possible without code duplication)	4 years ago
Mike Fährmann	3108e85b89	[worldthree] remove extractors ... http://www.slide.world-three.org/ hasn't been accessible for a long time.	4 years ago
Mike Fährmann	8fed3eb8cb	[jaiminisbox] remove extractors ... https://jaiminisbox.com/post.html	4 years ago
Mike Fährmann	3918b69677	remove 'extractor.blacklist' context manager	4 years ago
Mike Fährmann	c78aa17506	add general 'blacklist' and 'whitelist' options (#492, #844)	4 years ago
Mike Fährmann	5912727b88	support format string replacement fields in archive paths ... (closes #985)	4 years ago
Mike Fährmann	f6fd449b59	reduce wait time growth rate from exponential to linear ... Waiting for 2**N seconds after each error grows too fast. Simply waiting N seconds seems far more reasonable.	4 years ago
Mike Fährmann	ac3036ef56	add 'filesize-min' and 'filesize-max' options (closes #780)	4 years ago
Mike Fährmann	e33293fdd8	[hentaihand] update to new site layout	4 years ago
Mike Fährmann	ab1af66a97	[imgur] add 'search' extractor (#934)	4 years ago
ArtaxIsSleeping	0e941553ec	[aryion] Add username/password support (#960) ... * Add username/password support to aryion extractor * Update docs to match * Fix code style	4 years ago
Mike Fährmann	063c71cd84	[furaffinity] add 'search' extractor (closes #915)	4 years ago
Mike Fährmann	dbbbb21180	[exhentai] add ability to specify custom image limit (#940)	4 years ago
Mike Fährmann	2b88c90f6f	[blogger] add search extractor (#925)	4 years ago
Mike Fährmann	901a897e6f	[inkbunny] mention login support	4 years ago
Mike Fährmann	b921fee24d	[inkbunny] fix submission order (#283) ... Getting detailed submission info via /api_submissions.php reordered the input submissions and sorted them by ID. InkbunnyAPI.detail() now sorts them back and ensures they are returned in their original order. This commit also removes the 'metadata' option and always requests submission descriptions.	4 years ago
Mike Fährmann	c4ed9f4faa	[inkbunny] add 'metadata' option (#283)	4 years ago
Mike Fährmann	493cadb1e7	[inkbunny] add 'orderby' option (#283)	4 years ago
Mike Fährmann	8dbf827649	[bobx] remove module	4 years ago
Mike Fährmann	87202b8d74	[inkbunny] add 'user' and 'post' extractors (#283)	4 years ago
Mike Fährmann	b62ea72533	release version 1.14.3	4 years ago
Mike Fährmann	d5fcffcced	[subscribestar] add login capabilities (#852)	4 years ago
Mike Fährmann	ecaecc4064	[exhentai] add 'domain' option (#897)	4 years ago
Mike Fährmann	df7217c36d	update supportedsites.py (#889, #893) ... - mention optional auth access for more sites - link to OAuth and Cookies sections in README	4 years ago
HRXN	51b49a361d	mention optional auth access for furaffinity (#893)	4 years ago
jakem72360	7dfdcc3fbf	[mangakakalot] Added extractors for MangaKakalot (#876)	4 years ago
Mike Fährmann	cb0132e441	[khinsider] add 'format' option (closes #840)	4 years ago
Mike Fährmann	c28db7a6ea	[8muses] support 'comics.8muses.com' URLs	4 years ago
Mike Fährmann	821524e4ee	[subscribestar] add 'user' and 'post' extractors (#852)	4 years ago
Mike Fährmann	f1ddbff0b5	[aryion] add 'recursive' option (fixes #832) ... This is enabled by default and will recursively go through all (sub)folders in an artist's gallery. The old method of using "Latest Updates" lists can be restored by disabling this option.	4 years ago
Mike Fährmann	9da2bc67f8	[twitter] add option to filter media from quoted tweets (#854)	4 years ago
Mike Fährmann	0e714b9a0e	[pinterest] add 'section' extractor (#835)	4 years ago
Mike Fährmann	5ba90f72ca	[pinterest] add support for sections (closes #835)	4 years ago
Mike Fährmann	c37a1c06c8	[twitter] add extractor for liked tweets (closes #837) ... You need to be logged in to get access to anyone's liked tweets, it seems.	4 years ago
Mike Fährmann	c184cce876	update configuration.rst ... - fix anonymous links - update description of 'extractor.twitter.videos' - document 'extractor.redgifs.format' (#724)	4 years ago
Mike Fährmann	cf863f60b3	[redgifs] add 'user' and 'search' extractors (closes #724)	4 years ago
Mike Fährmann	4aea5138dd	[sensescans] use https://	4 years ago
Mike Fährmann	41d03160ff	[deviantart] also search journals for sta.sh links (#712) ... when 'extra' is enabled	4 years ago
Mike Fährmann	0138e9c1d8	[twitter] remove 'content' option ... The text content of each tweet is always available as 'full_text'	4 years ago
Mike Fährmann	0f459f340b	[instagram] fix and re-enable login with username&password ... This reverts commit 3e0848a482. (#756, #771, #797, #803) https://github.com/althonos/InsaLooter/issues/287#issuecomment-630456522	4 years ago
Mike Fährmann	3e0848a482	[instagram] disable login with username&password (#756)	4 years ago
Mike Fährmann	da22ea8ced	use %APPDATA%\gallery-dl for config/cache on Windows	4 years ago
Mike Fährmann	45baa13615	update extractor test results ... - don't run Instagram tests on Travis anymore - replace Twitter test because timeline was made private - update Hiperdex domain to '.com' (again ...)	4 years ago
Mike Fährmann	b489f4de12	fix internal links in configuration.rst	4 years ago
Mike Fährmann	dfcf2a2c91	write OAuth token to cache by default (#616)	4 years ago
Mike Fährmann	ddc253cf9a	implement a 'path-replace' option (#662, #755)	4 years ago
Mike Fährmann	7003e61d1d	add a few more examples to gallery-dl-example.conf ... - include 'igneous' and 'hath_perks' in Exhentai cookies - add an example of how to write DeviantArt description to file - add a 'path-restrict' mapping from invalid characters in Windows paths to Unicode alternatives (taken from #662)	4 years ago
Mike Fährmann	bc53302ad6	extend 'path-restrict' option ... Allow its value to be a JSON object / Python dict that specifies a mapping from invalid/unwanted input characters to specific output characters. For example {"/": "-", "*": "+"} will transform "foo / ***bar***" into "foo - +++bar+++" (closes #662, #755)	4 years ago
Mike Fährmann	e19f665a44	[danbooru] change default for 'ugoira' to 'false' ... Downloading the pre-rendered versions should be a better default than .zip files with individual frames.	4 years ago
Mike Fährmann	0378d079a5	[webtoons] fixes and simplifications (#593, #761) ... - fix episode listings for french comics - allow input URLs without explicit scheme - add 'lang'/'language' metadata - use str.format() instead of '+' to assemble URLs	4 years ago
Mike Fährmann	ab11b1c896	[imagechest] simplify code (#750)	4 years ago
Mike Fährmann	dba87ca99e	[downloader:ytdl] change 'forward-cookies' default to 'false' ... There are currently no situations where forwarding gallery-dl's cookies to youtube-dl is necessary, and it only causes problems when forcing youtube-dl for Twitter video downloads while logged in.	4 years ago
Mike Fährmann	2d6724180b	[hiperdex] update domain to hiperdex.info	4 years ago
Mike Fährmann	be16d77073	simplify and improve documentation markup (#742) ... - use | to get a more "compact" representation - link directly to example config files	4 years ago
Vrihub	fe224416bf	Some documentation improvements (#742) ... * Link configuration examples in the intro, see #712 * Clarify overriding conf files by options, see #678	4 years ago
Mike Fährmann	f557cac074	[redgifs] add image extractor (#724)	4 years ago
Mike Fährmann	ba42ec321c	release version 1.13.6	4 years ago
Mike Fährmann	ff47641b13	test whether default/example config files contain valid JSON	4 years ago
Mike Fährmann	5e2974d699	[weibo] add 'videos' option	4 years ago
Mike Fährmann	9f638c2e01	[twitter] add 'replies' option (closes #705)	4 years ago
Mike Fährmann	a4fd620a25	[hiperdex] revert domain back to hiperdex.com	4 years ago
Mike Fährmann	a3de234e70	[hitomi] add extractor for tag searches (closes #697)	4 years ago
Mike Fährmann	d5273f9b0c	[hiperdex] update domain to hiperdex.net	4 years ago
Mike Fährmann	a6286bb551	[hiperdex] add 'artist' extractor (#606)	5 years ago
Mike Fährmann	6143050980	[aryion] add gallery and post extractors (#390, #673)	5 years ago
Mike Fährmann	2587296deb	[mastodon] add access tokens for mastodon.social and baraag.net ... (closes #665)	5 years ago
Mike Fährmann	4203dc0bdc	[mangapark] fix metadata extraction	5 years ago
Mike Fährmann	88ebbadc58	remove dashes from subcategory names in supportedsites.rst	5 years ago
Mike Fährmann	09f2271528	[35photo] add 'tag' extractor	5 years ago
Mike Fährmann	90d15e3682	[instagram] use 'itertools.chain()'	5 years ago
Mike Fährmann	5b676ea59d	[e621] document username & password support (#640)	5 years ago
Mike Fährmann	fdd2dd5136	[kabeuchi] add 'user' extractor (closes #561)	5 years ago
Mike Fährmann	59edcdc822	[hitomi] restore metadata fields from before f33b13a ... ... and add a 'metadata' option to disable visiting the gallery page and extracting data from it if this is not needed.	5 years ago
Mike Fährmann	823fbeaae6	[newgrounds] add 'favorite' extractor (#394)	5 years ago
Mike Fährmann	a45fbc38ea	[pixiv] implement 'avatar' option (#595, #623)	5 years ago
Mike Fährmann	32df8d06fe	[twitter] add 'bookmark' extractor (closes #625)	5 years ago
Mike Fährmann	cc5079c844	[hiperdex] add chapter and manga extractors (closes #606)	5 years ago
Mike Fährmann	6e759fe2f5	reword note for 'extractor.deviantart.refresh-token' (#612)	5 years ago
Mike Fährmann	765b2a0527	[hentaihand] add extractors (closes #605)	5 years ago
Mike Fährmann	67ea80222c	link to post processor example in 'pixiv.ugoira' docs	5 years ago
Mike Fährmann	74e684e828	[twitter] change default value for 'videos' to 'true' ... Every other 'videos' option defaulted to 'true', except Twitter.	5 years ago
Mike Fährmann	ab13f81fd7	add example to 'cookies' docs	5 years ago
Mike Fährmann	c7cf9dd111	[furaffinity] support classic layout (#284)	5 years ago
Mike Fährmann	138135c190	[furaffinity] add extractors (#284)	5 years ago
Mike Fährmann	da0d5f6092	[oauth] add 'port' option (#604)	5 years ago
Mike Fährmann	719b63d0ca	[bcy] add user and post extractors (#592)	5 years ago
Mike Fährmann	091f9a107d	[docs] add examples of how to filter manga chapters by language ... (closes #599)	5 years ago
Mike Fährmann	1f4c9c5f9d	[8kun] add thread and board extractors (closes #582)	5 years ago
Mike Fährmann	dff33b260c	[reddit] add 'videos' option	5 years ago
Mike Fährmann	cf7a67d67f	[yaplog] remove module ... Yaplog! ended its service on 2020-01-31	5 years ago
Mike Fährmann	56f1c96168	implement 'parent-directory' option (#551)	5 years ago
Mike Fährmann	6703b8a86b	[blogger] implement video extraction (closes #587)	5 years ago
Mike Fährmann	37247dbaff	miscellaneous fixes	5 years ago
Mike Fährmann	25d5ec4ff3	[twitter] add option to extract TwitPic embeds (#579)	5 years ago
Mike Fährmann	254f7c3999	implement a post-processor module to compare file versions ... (#530)	5 years ago
Mike Fährmann	a6b98d3bec	fix auto-generation of supportedsites.rst	5 years ago
Mike Fährmann	5cac79c3d9	[erolord] remove extractor	5 years ago
Mike Fährmann	87c8b89ddd	[postprocessor:metadata] add 'directory' option (#520)	5 years ago
Mike Fährmann	48e42e73fb	[reddit] change default value for 'comments' to '0'	5 years ago
Mike Fährmann	bf658fd84b	[vsco] implement 'videos' option	5 years ago
Mike Fährmann	95c90722ee	[instagram] implement 'videos' option (closes #521)	5 years ago
The Oddball	9a4ce20b8e	[realbooru] Add Realbooru extractor (#514)	5 years ago