2635 Commits (ba69fb669dd1d7d4fd6f991fdc8643e974f4d2d9)

Author	SHA1	Message	Date
Mike Fährmann	8d676151b7	[patreon] implement 'files' option (#1935)	3 years ago
Mike Fährmann	6695ef2e10	[patreon] better filenames for 'content' images (#1954)	3 years ago
Mike Fährmann	70005e3275	[kemonoparty:discord] support downloading from a specific channel ... https://kemono.party/discord/server/<server-id>#<channel-name>>	3 years ago
Mike Fährmann	003f25931d	[kemonoparty:discord] provide a 'channel_name'	3 years ago
Mike Fährmann	28bdd58e6d	[nhentai] simplify	3 years ago
Mike Fährmann	50098762e3	[nhentai] add 'tag' extractor (closes #1950)	3 years ago
Mike Fährmann	fe6ce5495a	[kemonoparty] add 'discord' extractor (#1827, #1940)	3 years ago
Mike Fährmann	918fc9974d	[picarto] add 'gallery' extractor (closes #1931)	3 years ago
Mike Fährmann	e33125ad39	[pixiv] add 'sketch' extractor (#1497)	3 years ago
Mike Fährmann	e9dc6ff262	[inkbunny] add 'following' extractor (#515)	3 years ago
Mike Fährmann	9c8fc6e7b4	[inkbunny] match "long" URLs for pools and favorites (#1937)	3 years ago
Mike Fährmann	f33c2ef73b	[cyberdrop] extract direct download URLs (#1943) ... do not rely on redirects from f.cyberdrop.cc	3 years ago
Mike Fährmann	b93915c113	[inkbunny] add 'pool' extractor (#1937)	3 years ago
Mike Fährmann	373d3e1c57	[seisoparty] implement login with username & password (#1906)	3 years ago
Mike Fährmann	7c5f62b453	[seisoparty] add 'favorite' extractor (#1906)	3 years ago
Mike Fährmann	d93b5474c3	[mangadex] update parameter handling for API requests ... - move common parameters into '_pagination()' - add 'ratings' (#1908) and 'api-parameters' options	3 years ago
Mike Fährmann	cd66c3c415	[twitter] add 'size' option (#1881)	3 years ago
Mike Fährmann	fb98b3fdaf	[redgifs][gfycat] remove webtoken code (fixes #1907)	3 years ago
Mike Fährmann	96215c926e	[mangadex] fix retrieving chapters from 'pornographic' titles ... (fixes #1908)	3 years ago
Mike Fährmann	da9685609c	[kemonoparty] update file download URLs ... (closes #1902, fixes #1903)	3 years ago
Mike Fährmann	783eae6fc5	[hiperdex] fix extraction	3 years ago
Mike Fährmann	e0bdacd932	[fappic] add 'image' extractor (closes #1898)	3 years ago
Mike Fährmann	9377543162	[mastodon] add 'following' extractor (#1891)	3 years ago
Mike Fährmann	2c2932973c	[mastodon] support specifying accounts by ID ... Same as a3b473bd for Twitter Instead of just https://instance.tld/@user it is now also possible to refer to that account with https://instance.tld/users/user https://instance.tld/@id:12345 https://instance.tld/users/id:12345	3 years ago
Mike Fährmann	94143eb86c	[twitter] add 'quote_by' metadata field (#1481) ... Only present for tweets quoted by another tweet. Represents the tweet_id of said tweet quoting this one.	3 years ago
Mike Fährmann	a23f5d45d7	[deviantart] fix bug with fetching premium content (#1879) ... When a user has both 'watchers' and 'paid' folders and one of them is inaccessible, the other one could get handled as inaccessible as well.	3 years ago
Mike Fährmann	ada36c2044	[deviantart] update default archive_fmt for single deviations ... (#1874) use the same as gallery downloads	3 years ago
Mike Fährmann	da16eabb82	[twitter] ensure card entries have a 'url' (#1868)	3 years ago
Mike Fährmann	e69ee41f25	implement 'page-reverse' option (#1854)	3 years ago
cyberdrop-me	c83668c2ff	[CyberDrop] Change directory name format (#1871) ... Album IDs are random, organization would be much better having the album name then the identifier at the end	3 years ago
Mike Fährmann	e4684c5cb9	[desktopography] simplify (#1740)	3 years ago
Giacomo Rossetto	4a7d7899ff	Implement desktopography extractor (#1740)	3 years ago
Alice	9992ff38da	[fantia] add 'date' metadata field (#1853)	3 years ago
Mike Fährmann	fba95c3a9e	[nozomi] preserve case of search tags (fixes #1860)	3 years ago
Mike Fährmann	4b3e309b90	[aryion] update/improve pagination (#1849) ... Manually increment the 'p' query parameter, instead of relying on a "Next" link which only works up to page 200.	3 years ago
Mike Fährmann	266ed9b62e	[aryion] add 'tag' extractor (closes #1849)	3 years ago
Mike Fährmann	6bbeaac029	[mangadex] fix extraction (fixes #1852)	3 years ago
Mike Fährmann	e9bf8d2591	[instagram] update default delay to 6-12 seconds (#1835)	3 years ago
Mike Fährmann	c9e6693530	allow specifying a minimum/maximum for 'sleep-*' options (#1835) ... for example '"sleep-request": [5.0, 10.0]' to wait between 5 and 10 seconds between each HTTP request	3 years ago
Mike Fährmann	2ff2974353	[common] update default argument handling in Extractor.request() ... more lines of code, but slightly less execution time	3 years ago
Mike Fährmann	0fd959a2a7	[twitter] support '/with_replies' URLs (closes #1833)	3 years ago
Mike Fährmann	e93360e45d	[reddit] extend subcategory depending on input URL (closes #1836) ... - https://www.reddit.com/r/lavaporn/ -> 'subreddit' - https://www.reddit.com/r/lavaporn/new/ -> 'subreddit-new' - https://www.reddit.com/user/username/ -> 'user' - https://www.reddit.com/user/username/gilded/ -> 'user-gilded'	3 years ago
Mike Fährmann	7bbb1f92d7	[gelbooru_v02] add 'favorite' extractor (closes #1834)	3 years ago
Mike Fährmann	4ec11af6a4	[kemonoparty] implement login with username & password (#1824)	3 years ago
Mike Fährmann	0e33746fe0	[artstation] use '/album/all' view for user portfolios (#1826)	3 years ago
Mike Fährmann	4f5f9ed1e5	[oauth] fix typo ... this has been here since February ... (8974f036)	3 years ago
Mike Fährmann	83bbb628d8	[kemonoparty] add 'favorite' extractor (#1824)	3 years ago
Mike Fährmann	35d75a4071	[erome] send Referer header for file downloads (fixes #1829)	3 years ago
Mike Fährmann	44f572c27f	[deviantart] implement a 'auto-unwatch' option (#1466, #1757)	3 years ago
Mike Fährmann	d79bcb6236	allow extractors to register a 'finalize()' method	3 years ago
Mike Fährmann	47a780942c	update extractor test results	3 years ago
Mike Fährmann	eed6ef3de0	[pixiv] fix pixivision title extraction	3 years ago
Mike Fährmann	7645cdfb88	[inkbunny] fix extraction (closes #1816) ... 'digitalsales', 'forsale', and 'printsales' are no longer included in the data returned from the API.	3 years ago
Mike Fährmann	3e36543c98	[nhentai] add 'favorite' extractor (#1814)	3 years ago
Mike Fährmann	656358ea92	[nhentai] use API endpoint for gallery data	3 years ago
Mike Fährmann	8cd7759682	[reddit] cleanup ReddeitAPI.__init__ (#1813) ... - remove warning about 'client-id'/'user-agent' mismatch - only use 'user-agent' from config for custom 'client-id'	3 years ago
Mike Fährmann	0a94fe5774	[reddit] delay RedditAPI initialization (#1813) ... Move it outside the constructor so that eventual exceptions can get caught in the expected places.	3 years ago
Mike Fährmann	57854624a1	[exhentai] improve image limits check (#1808) ... Check for a 'text/html' Content-Type instead of the very specific 137 bytes Content-Length, which might change depending on compression or other factors.	3 years ago
Mike Fährmann	96fec14ef7	[deviantart] rename 'watch' option to 'auto-watch' ... (#1466, #1757) Similar reason as in e05a96db. 'watch' is already used by the WatchExtractor class.	3 years ago
Mike Fährmann	e75f2de9da	[deviantart] add 'comments' option (#1800)	3 years ago
Mike Fährmann	6ce16c6d31	[deviantart] add 'tag' extractor (closes #1803)	3 years ago
Mike Fährmann	4e9f8fe395	[shopify] support windsorstore.com (#1793)	3 years ago
Mike Fährmann	95157e0f4b	[shopify] use API for product listings (#1793)	3 years ago
Mike Fährmann	6651da27e9	[twitter] fix 'url' extraction for users without 'expanded_url' ... (#1532, #1787)	3 years ago
Mike Fährmann	ecc8da4704	[deviantart] implement a 'watch' option (#1466, #1757)	3 years ago
Mike Fährmann	a4f249c22e	[deviantart] prevent exception on empty videos (fixes #1796)	3 years ago
Mike Fährmann	ae78d95a5f	[twitter] fix issue when filtering quote tweets (#1792) ... When a user quotes his own Tweet and that Tweet gets filtered by '"quoted": false', it could also get filtered when it appeared later as regular Tweet.	3 years ago
Mike Fährmann	6b229ac829	[furaffinity] expand URL pattern for searches (closes #1780)	3 years ago
Mike Fährmann	0817f468ef	[twitter] expand t.co links in user descriptions (#1532, #1787)	3 years ago
Mike Fährmann	7c0ae88185	[twitter] add 'url' to user objects (#1532, #1787)	3 years ago
Mike Fährmann	5919dc5b5a	[twitter] slightly improve '_transform_user()'	3 years ago
Mike Fährmann	c04f7ab139	[foolfuuka] add 'gallery' extractor (#1785)	3 years ago
Mike Fährmann	ddd175de77	[mangadex] prevent KeyError for manga without English title	3 years ago
Mike Fährmann	20ee091289	[429chan] add 'thread' and 'board' extractors (closes #1773)	3 years ago
Mike Fährmann	6b56b3ebe1	[twitter] report API errors as generic StopExtraction exceptions ... prevents duplicate logging messages for nonexistent users (#1759)	3 years ago
Mike Fährmann	51eb50749f	[foolslide] remove entry for kobato.hologfx.com	3 years ago
Mike Fährmann	4718f9c5dd	[oauth] use defaults when config values are set to None/null ... (fixes #1778)	3 years ago
James C. Wise	1f02878351	[Deviantart] [#1776] Remove the "you need session cookies to download mature scraps" warning (#1777)	3 years ago
Mike Fährmann	bb6a130942	automatically set required DDoS-GUARD cookies (#1779) ... for kemono.party and seiso.party	3 years ago
Mike Fährmann	bd08ee2859	remove most 'yield Message.Version' statements ... only leave them in oauth.py as noop results	3 years ago
Mike Fährmann	c866fcba48	[twitter] fix 'logout' (#1719) ... delete 'auth_token' cookie and cookies.txt path	3 years ago
Mike Fährmann	9cb5ea5eda	update default User-Agent headers	3 years ago
Mike Fährmann	52984f7e22	[twitter] add option to log out when blocked (#1719)	3 years ago
Mike Fährmann	ed4b3c48cb	fix flake8 and other tests	3 years ago
enormous-muscles	975e1ac6e2	Add Wikieat extractor (#1699) ... * Add Wikieat extractor * Add Wikieat extractor to extractor list	3 years ago
Nyasume	fa6af46756	Added ability to download GIFs instead of mp4 from Luscious and Reactor (#1701)	3 years ago
Ryu JuHeon	9429eaa0a3	[hitomi]: fix image URLs (#1765)	3 years ago
Mike Fährmann	c34dbc86bb	[kemonoparty] update file server domain (#1764)	3 years ago
Mike Fährmann	e5a93e113f	[twitter] extend 'replies' option (#1254) ... Allow setting 'replies to '"self"' to only download from self-replies.	3 years ago
Mike Fährmann	f9096584ab	[behance] fix 'collection' extraction	3 years ago
Mike Fährmann	229498b8aa	[twitter] warn about suspended accounts etc (closes #1759)	3 years ago
Mike Fährmann	a5de2244d4	[furaffinity] fix using 'category-tranfer' (#1274)	3 years ago
Mike Fährmann	cadfad4eea	[danbooru] add 'external' option (closes #1747)	3 years ago
Mike Fährmann	5b1c62bfa9	[furaffinity] add 'external' option (closes #1492)	3 years ago
Mike Fährmann	5d5ab669fa	[instagram] use custom User-Agent header for video downloads ... (#1682, #1623, #1580)	3 years ago
Mike Fährmann	7b029dfe85	[instagram] increase default delay between HTTP requests to 8s ... (closes #1732)	3 years ago
Mike Fährmann	5eca3781be	[kemonoparty] fix username extraction (#1750)	3 years ago
Mike Fährmann	fe970fc87f	[vk] prevent exception for empty/private profiles (fixes 1742)	3 years ago
Mike Fährmann	ac91a84543	[bbc] provide fallback URLs (#1706)	3 years ago
Mike Fährmann	a316e44f8e	[bbc] add 'width' option (#1706)	3 years ago
Mike Fährmann	c37c2818fb	[nsfwalbum] retry all requests when extracting image URLs ... (#1733, fixes #1271)	3 years ago
Mike Fährmann	220cfe244e	[deviantart] get original files for GIF previews (#1731)	3 years ago
Mike Fährmann	7a0da4f93f	[newgrounds] add 'format' option (closes #1729)	3 years ago
Mike Fährmann	223a4e79cd	[newgrounds] fix using 'category-tranfer' (#1274)	3 years ago
Mike Fährmann	4e95cef6d2	[nsfwalbum] retry backend requests (fixes #1733)	3 years ago
Mike Fährmann	6c11105587	[bbc] improve image dimensions (#1706) ... download the 1920xN versions instead of 976x549	3 years ago
Mike Fährmann	57c1a86082	[bbc] support multi-page gallery listings (closes #1730)	3 years ago
Mike Fährmann	486474800f	[kemonoparty] skip duplicated patreon files (closes #1689) ... this behavior can be disabled with the 'patreon-skip-file' option	3 years ago
Mike Fährmann	da7297c0b9	[comicvine] add extractor (closes #1712)	3 years ago
Mike Fährmann	e4788fa663	[bbc] add 'gallery' and 'programme' extractors (closes #1706)	3 years ago
Mike Fährmann	c3b5c88b04	update extractor test results	3 years ago
Mike Fährmann	3868ec02d1	[pururin] update domain and fix extraction	3 years ago
Mike Fährmann	b89a44090f	[naverwebtoon] fix comic extraction	3 years ago
Mike Fährmann	c8e678a5b4	[instagram] fix extraction of '/explore/tags/' posts ... (closes #1666)	3 years ago
Mike Fährmann	a6a51f207d	[moebooru] fix 'tags' ending with a '+' when logged in (#1702)	3 years ago
Mike Fährmann	f5b097165e	[ytdl] transfer YoutubeDL objects to downloader (#1680) ... allows specifying downloader-specific options per subcategory but overwrites all downloader.ytdl settings	3 years ago
Mike Fährmann	06e69ea79a	[ytdl] actually set options for YoutubeDL objects (#1680) ... I somehow managed to remove the options parameter for the YoutubeDL constructor in 9a849cdf without noticing ...	3 years ago
Mike Fährmann	dfe1f490e9	[mangadex] use custom User-Agent header (#1535)	3 years ago
Mike Fährmann	36a2aff363	[vk] improve metadata extraction and URL pattern (fixes #1691) ... - always fetch all user metadata - use 'user[name]' for directory names if available	3 years ago
Mike Fährmann	e622e004f0	[ytdl] improve module imports (#1680) ... Apply 'extractor.ytdl.module' for every URL, not just the first.	3 years ago
Mike Fährmann	193401ce3b	[ytdl] "fix" cookie transfer between session and ytdl (#1680) ... requests' CookieJar class is not quite compatible with the standard http.cookiejar.CookieJar used by youtube_dl	3 years ago
Mike Fährmann	9a849cdf61	[ytdl] allow setting 'module' for subcategories (#1680)	3 years ago
Mike Fährmann	dff0da60f9	[ytdl] add 'generic' option (#1680)	3 years ago
Mike Fährmann	d3da96142a	[ytdl] support cookies + username&password (#1680)	3 years ago
Mike Fährmann	36ac2197db	[ytdl] add extractor for sites supported by youtube-dl ... (#1680, #878) Can be used by prefixing any URL with 'ytdl:', or by setting 'extractor,ytdl.enabled' to 'true'.	3 years ago
Mike Fährmann	64240c8d42	[imagevenue] fix extraction ... (closes #1677)	3 years ago
Mike Fährmann	d287d2eb88	[kemonoparty] parse 'o' query parameters (#1674)	3 years ago
Mike Fährmann	8b036778e3	[kemonoparty] add 'max-posts' option (#1674)	3 years ago
Mike Fährmann	5612ca31c2	[hitomi] fix image URLs (closes #1679)	3 years ago
Mike Fährmann	8ecca3af58	[pixiv] add extractor for 'pixivision' articles (#1672)	3 years ago
Mike Fährmann	312a28e78a	[mastodon] add 'replies' option (#1669)	3 years ago
Mike Fährmann	513c491cea	[mastodon] reset 'params' after first pagination iteration ... otherwise query parameters in 'params' get specified twice the second time around - once from the 'links["next"]' URL and once from 'params' itself.	3 years ago
Mike Fährmann	a1f5b78039	[mastodon] add 'reblogs' option (#1669)	3 years ago
Mike Fährmann	21c2da454f	update extractor test results	3 years ago
Mike Fährmann	7f591c78cb	[mangafox] cleanup	3 years ago
FollieHiyuki	4763bc1e4e	Add MangaExtractor for mangafox (#1633)	3 years ago
Mike Fährmann	b519bf567c	[hiperdex] use domain from input URL	3 years ago
Mike Fährmann	93d356712c	[mastodon] implement 'text-posts' option (#1569) ... similar to Twitter's 'text-tweets'	3 years ago
Mike Fährmann	414bdc95a3	[twitter] set 'retweet_id' for original retweets (#1481)	3 years ago
Mike Fährmann	5323c1c73a	[twitter] ensure guest tokens are returned as string (#1665)	3 years ago
Mike Fährmann	9ee45f3617	[kemonoparty] warn about missing DDoS-GUARD cookies	3 years ago
Mike Fährmann	344aab3fb7	[seisoparty] warn about missing DDoS-GUARD cookies	3 years ago
Mike Fährmann	035562bd11	[twitter] remove old-style URLs from image fallback lists	3 years ago
Mike Fährmann	daf821b8b6	[seisoparty] use user names instead of IDs by default (#1635)	3 years ago
Mike Fährmann	e4db1bad14	[seisoparty] also extract files hosted on 'cdn-2' servers (#1635)	3 years ago
Mike Fährmann	267bbf5996	[mangasee] add 'chapter' and 'manga' extractors	3 years ago
Mike Fährmann	fad4918208	[deviantart] use UUIDs in internal folder/collection URLs	3 years ago
Mike Fährmann	0179581340	add 'T' format string conversion (#1646) ... to convert 'date'/datetime to timestamp	3 years ago
Mike Fährmann	f74cf52e2b	[seisoparty] add 'user' and 'post' extractors (#1635)	3 years ago
Mike Fährmann	759735fb02	[kemonoparty] fix 'username' extraction (fixes #1652) ... The site's <title> content changed from <title>NAME | Kemono</title> to <title> NAME | Kemono </title>	3 years ago
Mike Fährmann	a416e54765	[directlink] manually encode Referer URLs (fixes #1647) ... Trying to send a non-latin-1-encodable header raises an exception, so we encode the Referer value ourselves with 'errors=ignore'.	3 years ago
Mike Fährmann	8bdeb2a6dd	[webtoons] match arbitrary language codes (closes #1643)	3 years ago
Mike Fährmann	4adc44df69	[furaffinity] improve metadata extraction (fixes #1630) ... Fetch 'title' and 'artist' metadata from a different location, since for posts with an empty title the <title> element is completely empty and does not contain the artist's name.	3 years ago
Mike Fährmann	e98fa01c44	[hitomi] update image URL code (fixes #1637)	3 years ago
Mike Fährmann	e9ab97396f	[kemonoparty] update default filenames and archive IDs (#1514) ... Add an enumeration index so that attachments and regular files with the same filename still get downloaded and not counted as duplicate files (even though for patreon posts they usually are) This invalidates all previously generated archive IDs. To keep using old names and IDs, set 'filename' to "{id}_{title}_{filename}.{extension}" and 'archive-format' to "{service}_{user}_{id}_{filename}.{extension}".	3 years ago
Mike Fährmann	fb4b4725ba	[hiperdex] match 'hiperdex2.com' URLs ... still doesn't properly work due to Cloudflare CAPTCHA and IUAM page	3 years ago
Mike Fährmann	95bc1139e0	[instagram] update query hashes	3 years ago
Mike Fährmann	23018a46f6	[instagram] fix login (fixes #1631)	3 years ago
Mike Fährmann	cac0110d8b	[redgifs] update API server address (fixes #1632) ... napi.redgifs.com -> api.redgifs.com	3 years ago
Mike Fährmann	0d2961ae81	[500px] remove last query hash entry ... forgot to include this in b56e2450	3 years ago
Mike Fährmann	7273cf8536	[pixiv] support fetching privately followed users (fixes #1628)	3 years ago
Mike Fährmann	e60962f7e5	[philomena] improve tag escapes handling (fixes #1629)	3 years ago
Mike Fährmann	d8908ca577	[unsplash] update collections URL pattern (fixes #1627)	3 years ago
Mike Fährmann	9ed13703cc	[sankaku] handle empty tags (fixes #1617)	3 years ago
Mike Fährmann	b56e245094	[500px] update GraphQL queries ... 500px changed its method from query hashes to sending the entire query string for every request.	3 years ago
Mike Fährmann	a751afdfb3	[twitter] change some defaults ... - 'retweets' option: true -> false - 'quoted' option : true -> false i.e. disable downloading tweets from other user's timelines by default - search directory: '["{category}", "Search", "{search}"]' -> '["{category}", "{user[name]}"]' i.e. change it to the same as other twitter extractors (#1308)	3 years ago
Mike Fährmann	4e4ca3c330	[deviantart] pin API version (#1611) ... '/gallery/folders' in the newest version doesn't include subfolders. It probably only needs the right query parameter to do so, but that doesn't seem to be documented anywhere.	3 years ago
Mike Fährmann	d09bc5bd34	[subscribestar] improve attachment filenames (#1609)	3 years ago
Mike Fährmann	2986bf63bf	[mangafox] update URL pattern (fixes #1608) ... also accept non-numeric volume labels, e.g. vTBD	3 years ago
Mike Fährmann	53dab5c289	[mangadex] revert chapter handling (#1535) ... Spawn a new ChapterExtractor for each individual chapter instead of handling them directly with a MangaExtractor. Doing it that way broke too many features like --chapter-filter, --chapter-range, --zip, etc.	3 years ago
Mike Fährmann	1197ee2c20	[mangadex] add extractor for a user's followed feed (#1535)	3 years ago
Mike Fährmann	07c8adbd8b	[mangadex] implement login with username & password (#1535)	3 years ago
Mike Fährmann	3e332eaf53	[mangadex] update to API v5 (#1535)	3 years ago
Mike Fährmann	04f4f9badb	[oauth] prevent exceptions when reporting errors (#1603)	3 years ago
Mike Fährmann	a3bf878329	[idolcomplex] improve and fix pagination (#1601) ... always rely on the 'next-page-url' value and its query parameters	3 years ago
Mike Fährmann	e39c4633ba	[cyberdrop] b64decode -> a2b_base64	3 years ago
Mike Fährmann	407627ec86	[foolfuuka] support 'archive.wakarimasen.moe' (closes #1595)	3 years ago
Mike Fährmann	78f89d2e61	[idolcomplex] fix pagination (closes #1594)	3 years ago
Mike Fährmann	52052a0e1a	[manganelo] update domain to 'manganato.com'	3 years ago
Mike Fährmann	c80b18a477	[weibo] extend 'retweets' option (closes #1542) ... Setting 'retweets' to "original" will use metadata from the original posts, and not from the retweeted ones.	3 years ago
Mike Fährmann	c0fa5058da	[kemonoparty] actually add a 'type' metadata field (#1556)	3 years ago
thatfuckingbird	264beb8556	recognize v2.mangapark URLs (#1578) ... * recognize v2.mangapark URLs * update mangapark root url to use the v2 subdomain	3 years ago
thatfuckingbird	e6811c7450	[pixiv] implement 'max-posts' option (#1558) ... * implement max-rank for pixiv * rename to max-posts and make more generic	3 years ago
Mike Fährmann	8a909e478d	[imagebam] fix extraction of NSFW images (#1534)	3 years ago
Mike Fährmann	b5affc62aa	[twitter] rename 'text-only' to 'text-tweets' (#570)	3 years ago
Mike Fährmann	724ca61f36	[twitter] add 'text-only' option (#570)	3 years ago
Mike Fährmann	8fd8126117	fix ISO 639-1 code for Japanese ... "jp" -> "ja"	3 years ago
Mike Fährmann	2c60c7d798	[reactor] skip deleted/empty posts	3 years ago
Mike Fährmann	532ac79fb0	update extractor test results	3 years ago
Mike Fährmann	d7bc4a2b8b	[500px] update query hashes	3 years ago
Mike Fährmann	0f35aca728	[aryion] minor code updates	3 years ago
Mike Fährmann	2eb46452ad	[aryion] update 'needle' to not skip text posts (fixes #1568) ... on "Latest Updates" pages "class='thumb scrollthumb' href='/g4/view/" and "class='thumb' href='/g4/view/" both end with "thumb' href='/g4/view/"	3 years ago
Mike Fährmann	4fc9668922	[imgur] update URL patterns (#1561)	3 years ago
Mike Fährmann	1eabfa5c7a	[pillowfort] implement login with username & password (#846)	3 years ago
Mike Fährmann	24dd10ac3c	[patreon] extract user defined 'tags' (#1539, closes #1540)	3 years ago
Mike Fährmann	a7e4917ee1	[pillowfort] add 'inline' option (#846) ... to support images present in a post's 'content', but not listed in 'media'. also separates the file hash present at the beginning of each 'filename' into its own field.	3 years ago
Mike Fährmann	efa6cc8ec3	[pillowfort] add 'external' option (#846) ... for links to external Twitter posts etc.	3 years ago
Mike Fährmann	394fbb5f56	[twitter] strip useless t.co links (#1532) ... The 'full_text' of Tweets with media content usually ends with a t.co link to itself. This commit removes those.	3 years ago
Mike Fährmann	41457dbb1b	[twitter] resolve t.co URLs in 'content' (#1532)	3 years ago
Mike Fährmann	2b5d80862e	[kemonoparty] add 'type' metadata field (#1556) ... 'file', 'attachment', or 'inline'	3 years ago
Mike Fährmann	17b0ccb071	[twitter] add missing retweet media entities (fixes #1555) ... from the original tweets	3 years ago
Mike Fährmann	5eeaaee01d	[pixiv] add 'metadata' option (#1551)	3 years ago
Mike Fährmann	0717456b4e	[kemonoparty] add 'metadata' option (closes #1548) ... to fetch creator names with an additional HTTP request	3 years ago
Mike Fährmann	36ed1efcfb	[pixiv] rename "noop" value for 'tags' option to "original" ... (#1507)	3 years ago
Mike Fährmann	14f983eab6	[deviantart] use default ID when 'client-id' is None	3 years ago
Mike Fährmann	3e4ffb0821	[gelbooru] add extractor for '/redirect.php' URLs (#1530)	3 years ago
Mike Fährmann	5e54105ae4	[instagram] update query hashes	3 years ago
Mike Fährmann	b3ee10a7fb	[500px] update query hashes	3 years ago
Mike Fährmann	15b0241bbc	[imagebam] fix extraction	3 years ago
Mike Fährmann	38ae61edd4	[inkbunny] add 'favorite' extractor (#1521)	3 years ago
Mike Fährmann	577fffad5f	[nozomi] update 'archive_fmt' values for tag and search extractors ... … so they actually work for posts with more than 1 file. (fixes #1523)	3 years ago
Mike Fährmann	c5ca7905ce	add 'noop()' and 'identity()' functions	3 years ago
HRXN	e13cae182b	[nozomi] Extend default archive-fmt for Tag and Search Extractor (#1529) ... Closes #1523	3 years ago
Mike Fährmann	2133f1d77f	[readcomiconline] change domain to 'readcomiconline.li' ... (closes #1517)	3 years ago
Mike Fährmann	66f28e471c	[kemonoparty] update file URLs directly linking to kemono.party ... (#1514)	3 years ago
Mike Fährmann	6fa20d456b	[sankaku] update invalid-token detection (fixes #1515)	3 years ago
Mike Fährmann	4b65ebf652	[kemonoparty] fix file URLs (#1514) ... files are now hosted on https://data.kemono.party/	3 years ago
Mike Fährmann	fa519f9202	[pixiv] change 'translated-tags' option (#1507) ... - rename to 'tags' - use string-values: "japanese", "translated", "noop" - remove duplicate entries for "translated" tags	3 years ago
Mike Fährmann	221015e586	[downloader:http] disable filename extension changes for ugoira ... (#1507)	3 years ago
thatfuckingbird	e47952ac14	add extractors for fantia and fanbox (#1459) ... * add extractors for fantia and fanbox * appease linter * make docstrings unique * [fantia] refactor post extraction * [fantia] capitalize * [fantia] improve regex pattern * code style * capitalize * [fanbox] use BASE_PATTERN for url regexes * [fanbox] refactor metadata and post extraction * [fanbox] improve url base pattern * [fanbox] accept creator page links ending with /posts * [fanbox] more tests * [fantia] improved pagination * [fanbox] misc. code logic improvements * [fantia] finish restructuring pagination code * [fanbox] avoid making a request for each individual post when processing a creator page * [fanbox] support embedded videos * [fanbox] fix errors * [fanbox] document extractor.fanbox.videos * [fanbox] handle "article" and "entry" post types, all embeds * [fanbox] fix downloading of embedded fanbox posts	3 years ago
Mike Fährmann	d900edfcfb	[simplyhentai] fix extraction	3 years ago
Mike Fährmann	ba8180b5e6	[bcy] don't crash with deleted posts	3 years ago
Mike Fährmann	d108421461	[myportfolio] fix extraction	3 years ago
Mike Fährmann	8b22d4e667	[mangapark] use '"browser": "firefox"' by default ... to get rid of Cloudflare CAPTCHA resonses	3 years ago
Mike Fährmann	9514cb8c12	[exhentai] update 'limits' check (#1487) ... Only use 'limits' to set a custom upper bound. Checking if the actual maximum gets exceeded is not necessary.	3 years ago
thatfuckingbird	141ca4ac0a	[pixiv] also save untranslated tags when translated-tags is enabled (#1501)	3 years ago
Renan Vedovato Traba	9322c5e43b	[exhentai] restore limit config (#1487) ... This partially reverts commit e9ec91c8	3 years ago
Mike Fährmann	cb86bb9cc9	[hentaicosplays] add 'slug' metadata field (closes #1483)	3 years ago
Mike Fährmann	dddda7d0e7	[hentaicosplays] use GalleryExtractor (#1473)	3 years ago
Mike Fährmann	d88e34f17e	[webtoons] use GalleryExtractor	3 years ago
Mike Fährmann	c4210b5371	[webtoons] update agegate/GDPR cookies	3 years ago
Mike Fährmann	d89eb7536b	[naverwebtoon] use GalleryExtractor	3 years ago
Mike Fährmann	9b52eb9bf1	[naverwebtoon] ignore non-comic images	3 years ago
Mike Fährmann	bdfcc9c4b1	update extractor test results	3 years ago
Hans Christian Gunawan	334d690687	[hentaicosplays] Add extractor (#1473)	3 years ago
Mike Fährmann	82c32d25af	[500px] update query hashes	3 years ago
Mike Fährmann	de14b7ad7a	[slideshare] fix extraction	3 years ago
Mike Fährmann	bef3105121	[komikcast] fix extraction	3 years ago
Mike Fährmann	086925e685	[shopify] support omgmiamiswimwear.com (closes #1280)	3 years ago
thatfuckingbird	224b883ff4	[danbooru] add option for extended metadata extraction (#1458) ... * [danbooru] add option for extended metadata extraction * appease linter * [danbooru] update docs/configuration.rst * [danbooru] rename extended-metadata -> metadata	3 years ago
thatfuckingbird	dff03a6605	[booru] add an option to extract notes (only gelbooru for now) (#1457) ... * [booru] add an option to extract notes (currently implemented only for gelbooru) * appease linter * [gelbooru] rename "text" to "body" in note extraction * add a code comment about reusing return value of _extended_tags	3 years ago
Mike Fährmann	78d7ee3ef4	[yuki] remove module for yuki.la	3 years ago
Mike Fährmann	5a98bcec3a	[deviantart] improve folder name matching (fixes #1451)	3 years ago
thatfuckingbird	918b0441fb	[gelbooru] fix tag category extraction (#1455)	3 years ago
Mike Fährmann	fe6ce5b8f8	[erome] skip deleted albums (fixes #1447)	3 years ago
Mike Fährmann	457abf0e71	[deviantart] fix pagination for Eclipse results (fixes #1444) ... - don't crash on missing keys - use fallback for invalid 'nextOffset' values	3 years ago
Mike Fährmann	dee540050f	[8muses] fix JSON unobfuscation ... limit the characters that get modified, leave non-ASCII characters alone	4 years ago
Mike Fährmann	b869b3a9eb	[instagram] fetch media for incomplete GraphSidecar posts ... GraphSidecar results from /tagged pages don't contain all media elements, only the first one. (#1439)	4 years ago
Mike Fährmann	b0686d2174	[instagram] update query hashes	4 years ago
Mike Fährmann	e8e3717b71	[instagram] add extractor for /tagged posts (#1439)	4 years ago