2949 Commits (e95f99882fdc6d85154311c62bd5034b2aec8f5a)

Author	SHA1	Message	Date
Mike Fährmann	7273cf8536	[pixiv] support fetching privately followed users (fixes #1628)	3 years ago
Mike Fährmann	e60962f7e5	[philomena] improve tag escapes handling (fixes #1629)	3 years ago
Mike Fährmann	d8908ca577	[unsplash] update collections URL pattern (fixes #1627)	3 years ago
Mike Fährmann	9ed13703cc	[sankaku] handle empty tags (fixes #1617)	3 years ago
Mike Fährmann	b56e245094	[500px] update GraphQL queries ... 500px changed its method from query hashes to sending the entire query string for every request.	3 years ago
Mike Fährmann	e9993451c3	remove Python version checks	3 years ago
Mike Fährmann	40eb8025cc	require an argument for --clear-cache	3 years ago
Mike Fährmann	a751afdfb3	[twitter] change some defaults ... - 'retweets' option: true -> false - 'quoted' option : true -> false i.e. disable downloading tweets from other user's timelines by default - search directory: '["{category}", "Search", "{search}"]' -> '["{category}", "{user[name]}"]' i.e. change it to the same as other twitter extractors (#1308)	3 years ago
Mike Fährmann	4e4ca3c330	[deviantart] pin API version (#1611) ... '/gallery/folders' in the newest version doesn't include subfolders. It probably only needs the right query parameter to do so, but that doesn't seem to be documented anywhere.	3 years ago
Mike Fährmann	d09bc5bd34	[subscribestar] improve attachment filenames (#1609)	3 years ago
Mike Fährmann	2986bf63bf	[mangafox] update URL pattern (fixes #1608) ... also accept non-numeric volume labels, e.g. vTBD	3 years ago
Mike Fährmann	53dab5c289	[mangadex] revert chapter handling (#1535) ... Spawn a new ChapterExtractor for each individual chapter instead of handling them directly with a MangaExtractor. Doing it that way broke too many features like --chapter-filter, --chapter-range, --zip, etc.	3 years ago
Mike Fährmann	def0148582	restructure code in PathFormat constructor	3 years ago
Mike Fährmann	84d2e64024	combine conditional filenames into `filename` option (#1394)	3 years ago
Mike Fährmann	1197ee2c20	[mangadex] add extractor for a user's followed feed (#1535)	3 years ago
Mike Fährmann	07c8adbd8b	[mangadex] implement login with username & password (#1535)	3 years ago
Mike Fährmann	b93cbe6720	[postprocessor:zip] run 'finalize()' regardless of 'filter' (#1460)	3 years ago
Mike Fährmann	3e332eaf53	[mangadex] update to API v5 (#1535)	3 years ago
Mike Fährmann	ff8d0d7280	[postprocessor:metadata] ensure reliable tags order (fixes #1598)	3 years ago
Mike Fährmann	04f4f9badb	[oauth] prevent exceptions when reporting errors (#1603)	3 years ago
Mike Fährmann	dfe1e09df0	add '-T/--terminate' command-line option (#1399)	3 years ago
Mike Fährmann	6ecb710a7f	add '-P/--postprocessor' command-line option	3 years ago
Mike Fährmann	83fc4c1098	update post processor config capabilities ... This change makes it possible to specify just the name of a post processor in the "postprocessors" list instead of a dict with all of its options. The options for it will then be taken from inside the "postprocessor" block similar to "extractor", "downloader", or "output" blocks. This makes it possible to for example override the default settings for --write-metadata by specifying a custom "metadata" block, or to set a custom post processor block ("cbz") and then use it by referencing just its name in "postprocessors" lists. { "postprocessor": { "metadata": { "name": "metadata", "event": "post", "filename": "{tweet_id|post_id|id}.json" }, "cbz": { "name" : "zip", "compression": "store", "extension" : "cbz" } } }	3 years ago
Mike Fährmann	4a747a31a3	[postprocessor:metadata] handle dicts in mode;tags (fixes #1598)	3 years ago
Mike Fährmann	a3bf878329	[idolcomplex] improve and fix pagination (#1601) ... always rely on the 'next-page-url' value and its query parameters	3 years ago
Mike Fährmann	3cbbefd4ed	support 'filter' option for post processors (#1460)	3 years ago
Mike Fährmann	4cf40434d7	initial support for conditional filenames (#1394)	3 years ago
Mike Fährmann	0abad8bc12	implement 'compile_expression()'	3 years ago
Mike Fährmann	e39c4633ba	[cyberdrop] b64decode -> a2b_base64	3 years ago
Mike Fährmann	407627ec86	[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595)	3 years ago
Mike Fährmann	78f89d2e61	[idolcomplex] fix pagination (closes #1594)	3 years ago
Mike Fährmann	f14a36cfc9	release version 1.17.5	3 years ago
Mike Fährmann	52052a0e1a	[manganelo] update domain to 'manganato.com'	3 years ago
Mike Fährmann	c80b18a477	[weibo] extend 'retweets' option (closes #1542) ... Setting 'retweets' to "original" will use metadata from the original posts, and not from the retweeted ones.	3 years ago
Mike Fährmann	c0fa5058da	[kemonoparty] actually add a 'type' metadata field (#1556)	3 years ago
Mike Fährmann	bb50e85795	[postprocessor:ugoira] optimize writing ffconcat files ... collect all content in-memory first and write everything with a single 'write()'	3 years ago
Mike Fährmann	5c18db5fab	[postprocessor:ugoira] use 'concat' demuxer by default (#1550) ... 'image2' with nanasecond mtime timestamps doesn't work on Windows	3 years ago
Mike Fährmann	19a11fa11d	[postprocessor:ugoira] use frame extension from filenames (#1550)	3 years ago
Mike Fährmann	74d97e6c6b	[postprocessor:ugoira] add 'repeat-last-frame' option (#1550)	3 years ago
Mike Fährmann	be9547a5f3	[postprocessor:ugoira] use 'image2' demuxer (#1550) ... Ensures exact frame timecodes with no duplicate frames. Possible issues are the duration the last frame in an Ugoira with variable frame durations is shown and insufficient timestamp precision of the underlying file system (e.g. FAT32, ext3; works on ext4, tmpfs, NTFS).	3 years ago
thatfuckingbird	264beb8556	recognize v2.mangapark URLs (#1578) ... * recognize v2.mangapark URLs * update mangapark root url to use the v2 subdomain	3 years ago
thatfuckingbird	e6811c7450	[pixiv] implement 'max-posts' option (#1558) ... * implement max-rank for pixiv * rename to max-posts and make more generic	3 years ago
Mike Fährmann	8a909e478d	[imagebam] fix extraction of NSFW images (#1534)	3 years ago
Mike Fährmann	b5affc62aa	[twitter] rename 'text-only' to 'text-tweets' (#570)	3 years ago
Mike Fährmann	724ca61f36	[twitter] add 'text-only' option (#570)	3 years ago
Mike Fährmann	8fd8126117	fix ISO 639-1 code for Japanese ... "jp" -> "ja"	3 years ago
Mike Fährmann	2c60c7d798	[reactor] skip deleted/empty posts	3 years ago
Mike Fährmann	532ac79fb0	update extractor test results	3 years ago
Mike Fährmann	d7bc4a2b8b	[500px] update query hashes	3 years ago
Mike Fährmann	0f35aca728	[aryion] minor code updates	3 years ago
Mike Fährmann	2eb46452ad	[aryion] update 'needle' to not skip text posts (fixes #1568) ... on "Latest Updates" pages "class='thumb scrollthumb' href='/g4/view/" and "class='thumb' href='/g4/view/" both end with "thumb' href='/g4/view/"	3 years ago
Mike Fährmann	adf4d661b3	use '_extractor' info in UrlJobs	3 years ago
Mike Fährmann	4fc9668922	[imgur] update URL patterns (#1561)	3 years ago
Mike Fährmann	1eabfa5c7a	[pillowfort] implement login with username & password (#846)	3 years ago
Mike Fährmann	24dd10ac3c	[patreon] extract user defined 'tags' (#1539, closes #1540)	3 years ago
Mike Fährmann	a7e4917ee1	[pillowfort] add 'inline' option (#846) ... to support images present in a post's 'content', but not listed in 'media'. also separates the file hash present at the beginning of each 'filename' into its own field.	3 years ago
Mike Fährmann	efa6cc8ec3	[pillowfort] add 'external' option (#846) ... for links to external Twitter posts etc.	3 years ago
Mike Fährmann	394fbb5f56	[twitter] strip useless t.co links (#1532) ... The 'full_text' of Tweets with media content usually ends with a t.co link to itself. This commit removes those.	3 years ago
Mike Fährmann	3a7c3ff138	support XDG_CONFIG_HOME (closes #1545) ... This will only load either ${XDG_CONFIG_HOME}/gallery-dl/config.json or ${HOME}/.config/gallery-dl/config.json if XDG_CONFIG_HOME is empty, never both.	3 years ago
Mike Fährmann	41457dbb1b	[twitter] resolve t.co URLs in 'content' (#1532)	3 years ago
Mike Fährmann	2b5d80862e	[kemonoparty] add 'type' metadata field (#1556) ... 'file', 'attachment', or 'inline'	3 years ago
Mike Fährmann	17b0ccb071	[twitter] add missing retweet media entities (fixes #1555) ... from the original tweets	3 years ago
Mike Fährmann	5eeaaee01d	[pixiv] add 'metadata' option (#1551)	3 years ago
Mike Fährmann	0717456b4e	[kemonoparty] add 'metadata' option (closes #1548) ... to fetch creator names with an additional HTTP request	3 years ago
Mike Fährmann	b50b8e6cf4	refactor applying 'parent-…' options	3 years ago
Mike Fährmann	7ab8374385	add 'parent-skip' option (#1399)	3 years ago
Mike Fährmann	c693db5b1a	add '"skip": "terminate"' option ... Stops not only the current extractor/job, but all parent extractors/jobs as well.	3 years ago
Mike Fährmann	4835888acc	release version 1.17.4	3 years ago
Mike Fährmann	36ed1efcfb	[pixiv] rename "noop" value for 'tags' option to "original" ... (#1507)	3 years ago
Mike Fährmann	14f983eab6	[deviantart] use default ID when 'client-id' is None	3 years ago
Mike Fährmann	3e4ffb0821	[gelbooru] add extractor for '/redirect.php' URLs (#1530)	3 years ago
Mike Fährmann	5e54105ae4	[instagram] update query hashes	3 years ago
Mike Fährmann	b3ee10a7fb	[500px] update query hashes	3 years ago
Mike Fährmann	15b0241bbc	[imagebam] fix extraction	3 years ago
Mike Fährmann	38ae61edd4	[inkbunny] add 'favorite' extractor (#1521)	3 years ago
Mike Fährmann	577fffad5f	[nozomi] update 'archive_fmt' values for tag and search extractors ... … so they actually work for posts with more than 1 file. (fixes #1523)	3 years ago
Mike Fährmann	e300da1424	add 'output.skip' option	3 years ago
Mike Fährmann	c5ca7905ce	add 'noop()' and 'identity()' functions	3 years ago
Mike Fährmann	755164b36a	improve --clear-cache (#1230) ... Allow for an optional argument to only delete cached entries from a specific module. delete all cache entries $ gallery-dl --clear-cache or $ gallery-dl --clear-cache all only delete entries for instagram $ gallery-dl --clear-cache instagram	3 years ago
HRXN	e13cae182b	[nozomi] Extend default archive-fmt for Tag and Search Extractor (#1529) ... Closes #1523	3 years ago
Mike Fährmann	bc868e7bb8	consider apparently long extensions as part of the filename ... (#1516)	3 years ago
Mike Fährmann	2133f1d77f	[readcomiconline] change domain to 'readcomiconline.li' ... (closes #1517)	3 years ago
Mike Fährmann	66f28e471c	[kemonoparty] update file URLs directly linking to kemono.party ... (#1514)	3 years ago
Mike Fährmann	6fa20d456b	[sankaku] update invalid-token detection (fixes #1515)	3 years ago
Mike Fährmann	4b65ebf652	[kemonoparty] fix file URLs (#1514) ... files are now hosted on https://data.kemono.party/	3 years ago
Mike Fährmann	fa519f9202	[pixiv] change 'translated-tags' option (#1507) ... - rename to 'tags' - use string-values: "japanese", "translated", "noop" - remove duplicate entries for "translated" tags	3 years ago
Mike Fährmann	5b4da4b4bf	reorder config access in Job constructor ... (#1111)	3 years ago
Mike Fährmann	221015e586	[downloader:http] disable filename extension changes for ugoira ... (#1507)	3 years ago
Mike Fährmann	e5123f56c9	fix crash when using --no-download with --ugoira-conv (#1507)	3 years ago
Mike Fährmann	07b6661a87	release version 1.17.3	3 years ago
thatfuckingbird	e47952ac14	add extractors for fantia and fanbox (#1459) ... * add extractors for fantia and fanbox * appease linter * make docstrings unique * [fantia] refactor post extraction * [fantia] capitalize * [fantia] improve regex pattern * code style * capitalize * [fanbox] use BASE_PATTERN for url regexes * [fanbox] refactor metadata and post extraction * [fanbox] improve url base pattern * [fanbox] accept creator page links ending with /posts * [fanbox] more tests * [fantia] improved pagination * [fanbox] misc. code logic improvements * [fantia] finish restructuring pagination code * [fanbox] avoid making a request for each individual post when processing a creator page * [fanbox] support embedded videos * [fanbox] fix errors * [fanbox] document extractor.fanbox.videos * [fanbox] handle "article" and "entry" post types, all embeds * [fanbox] fix downloading of embedded fanbox posts	3 years ago
Mike Fährmann	d900edfcfb	[simplyhentai] fix extraction	3 years ago
Mike Fährmann	ba8180b5e6	[bcy] don't crash with deleted posts	3 years ago
Mike Fährmann	d108421461	[myportfolio] fix extraction	3 years ago
Mike Fährmann	8b22d4e667	[mangapark] use '"browser": "firefox"' by default ... to get rid of Cloudflare CAPTCHA resonses	3 years ago
Mike Fährmann	9514cb8c12	[exhentai] update 'limits' check (#1487) ... Only use 'limits' to set a custom upper bound. Checking if the actual maximum gets exceeded is not necessary.	3 years ago
thatfuckingbird	141ca4ac0a	[pixiv] also save untranslated tags when translated-tags is enabled (#1501)	3 years ago
Renan Vedovato Traba	9322c5e43b	[exhentai] restore limit config (#1487) ... This partially reverts commit e9ec91c8	3 years ago
Mike Fährmann	cb86bb9cc9	[hentaicosplays] add 'slug' metadata field (closes #1483)	3 years ago
Mike Fährmann	b4ed7cb961	fix 'category-transfer' (#1111) ... broken since commit 055c32e0	3 years ago