1651 Commits (ff7c0b7effe4d8a50219fd7e134560e4fcf04756)

Author	SHA1	Message	Date
Mike Fährmann	4e361b3008	add tests for specific datetime values	5 years ago
Mike Fährmann	80ecb99089	[hitomi] fix extraction	5 years ago
Mike Fährmann	247c9e1416	[vsco] update gallery URL pattern	5 years ago
Mike Fährmann	19ae6f3fc4	update test results ... - twitter: Don't test the whole kwdict, only the actual content, since the keyword hash changes whenever that user changes his display name. - khinsider: Download host changed	5 years ago
Mike Fährmann	cc5079c844	[hiperdex] add chapter and manga extractors (closes #606)	5 years ago
Mike Fährmann	64bdec8430	[deviantart] check availability of intermediary URLs (fixes #609)	5 years ago
Mike Fährmann	5607dd3646	[hitomi] follow multiple redirects	5 years ago
Mike Fährmann	765b2a0527	[hentaihand] add extractors (closes #605)	5 years ago
Mike Fährmann	d94215d119	[tumblr] replace '-' with ' ' in tag searches (fixes #611) ... To search for tags with actual minus signs in them (there shouldn't be too many,) manually replace those with url-encoded minus characters ('-' -> '%2d') before inputting them into gallery-dl: https://s679874.tumblr.com/tagged/tag-with-minus -> https://s679874.tumblr.com/tagged/tag%2dwith%2dminus	5 years ago
Mike Fährmann	e6cd49e78b	update extractor test results	5 years ago
Mike Fährmann	5d9437b398	[vsco] skip "invalid" entities	5 years ago
Mike Fährmann	650f2b6d58	[furaffinity] accept sfw.furaffinity.net URLs (closes #608) ... Just as an alias for regular URLs with no extra content filtering.	5 years ago
Mike Fährmann	74e684e828	[twitter] change default value for 'videos' to 'true' ... Every other 'videos' option defaulted to 'true', except Twitter.	5 years ago
Mike Fährmann	c7cf9dd111	[furaffinity] support classic layout (#284)	5 years ago
Mike Fährmann	138135c190	[furaffinity] add extractors (#284)	5 years ago
Mike Fährmann	b9c574bd1d	[patreon] log skipped files (#590)	5 years ago
Mike Fährmann	80ea9104b8	[8kun] adjust URL pattern	5 years ago
Mike Fährmann	ce26070231	[pixiv] reduce calls to '/user/detail'	5 years ago
Mike Fährmann	da0d5f6092	[oauth] add 'port' option (#604)	5 years ago
Mike Fährmann	719b63d0ca	[bcy] add user and post extractors (#592)	5 years ago
Mike Fährmann	6426e3efc7	[khinsider] fix and improve metadata extraction	5 years ago
Mike Fährmann	b7eb6cecbb	[pixiv] handle tags at the end of new bookmark URLs	5 years ago
Mike Fährmann	109f6c8685	[patreon] filter duplicate files per post (#590)	5 years ago
Mike Fährmann	b38cf59711	[sexcom] fix image URLs & parse 'date' fields	5 years ago
Mike Fährmann	1f4c9c5f9d	[8kun] add thread and board extractors (closes #582)	5 years ago
Mike Fährmann	facc5daa6d	[twitter] force old login page layout (fixes #584, fixes #598)	5 years ago
Mike Fährmann	d1de7dc296	[hitomi] implement workaround for "broken" redirects ... Some galleries redirect to a new "version" with different gallery id. This new version might not be available any more, but the /reader/ page for the original gallery id can still work.	5 years ago
Mike Fährmann	40fe062851	[pixiv] fix user id for bookmarks API calls (closes #596)	5 years ago
Mike Fährmann	91aaaf1a9e	[pixiv] add 'rating' metadata field (#595) ... A human-friendlier representation of 'x_restrict'	5 years ago
Mike Fährmann	dff33b260c	[reddit] add 'videos' option	5 years ago
Mike Fährmann	2ad43618cc	[piczel] fix extraction	5 years ago
Mike Fährmann	cf7a67d67f	[yaplog] remove module ... Yaplog! ended its service on 2020-01-31	5 years ago
Mike Fährmann	e0dd073ce0	[twitter] replace embedded tweet test ... the old one was deleted	5 years ago
Mike Fährmann	ec36df4851	[deviantart] fix video extraction from 'extended_fetch' results ... DeviantArt is now serving videos from wixmp servers (1), instead of the former film00.deviantart.com (2), even though those URLS are still functional. They seem to also have re-encoded those videos. The 10 MB 1080p video from (2) is now only available in 720p at ~20 MB (with a higher bitrate, but still …). Other videos are still available in 1080p, but not this one for some reason. (Changing the '720p' in (1) to '1080p' doesn't work.) (1) https://wixmp-ed30a86b8c4ca887773594c2.wixmp.com/v/mp4/9feaa2c9-1baf-4fc2-84f7-f3384b34cefe/d5gxnb5-282a2e9a-b552-40ff-8542-b3c5eed823f5.720p.a837d7cec12c41be8ca2ee53152cea3a.mp4 (2) https://film00.deviantart.net/4c1d/v/mp4/2012/279/d/1/_video____brushes_i_use_in_paint_tool_sai_by_chi_u-d5gxnb5.mp4	5 years ago
Mike Fährmann	48be2266ed	[deviantart] better error message for 'extended_fetch' (#585)	5 years ago
Mike Fährmann	71851a6241	[pixiv] update URLs of followed users to the new format	5 years ago
Mike Fährmann	d086f30b42	[reddit] restore archive keys for i.redd.it images	5 years ago
Mike Fährmann	56f1c96168	implement 'parent-directory' option (#551)	5 years ago
Mike Fährmann	ae07f92f7e	[reddit] rewrite extractor logic (closes #551) ... Handle images and videos hosted on Reddit "natively", allowing them to use reddit-specific metadata to build directory and file names.	5 years ago
Mike Fährmann	2852691d78	[paheal] replace test URL ... searching for 'k-on' doesn't yield any results anymore	5 years ago
Mike Fährmann	2a9be48511	improve util.load/save_cookiestxt() and add tests ... - take a file object as argument instead of an filename - accept whitespace before comments (" # comment") - map expiration "0" to None and not the number 0	5 years ago
Mike Fährmann	e35c2ea1a6	[weibo] use youtube-dl to download from m3u8 manifests	5 years ago
Mike Fährmann	6703b8a86b	[blogger] implement video extraction (closes #587)	5 years ago
Mike Fährmann	c1a6862863	implement functions to load/save cookies.txt files (closes #586) ... The methods of the standard libraries' MozillaCookieJar have several shortcomings (#HttpOnly_ cookies, 0 expiration timestamps, etc.) and require construction of an ultimately pointless CookieJar object.	5 years ago
Mike Fährmann	25d5ec4ff3	[twitter] add option to extract TwitPic embeds (#579)	5 years ago
Mike Fährmann	32d7195d08	[pinterest] improve detection of invalid pin.it links	5 years ago
Mike Fährmann	174117f827	allow multiple hashes for content tests	5 years ago
Alice	f498a9057f	[twitter] Fix stop before real end (#573) ... * [twitter] Fix stop before real end Fix for https://github.com/mikf/gallery-dl/issues/544. Makes sure that it really reached the end by checking that both "min_position" is null and "has_more_items" is false before stopping. * [twitter] Fix stop before real end (update)	5 years ago
Mike Fährmann	8bb32ee188	[hitomi] fix image URLs	5 years ago
Mike Fährmann	bd5ce9855c	allow GalleryExtractors to set URL-independent extensions	5 years ago
Mike Fährmann	af42c75152	[mangadex] revert domain to 'mangadex.org'	5 years ago
Mike Fährmann	e89413da22	update test results	5 years ago
Mike Fährmann	33a6e0ac6e	[hentaifoundry] extract more metadata (closes #565)	5 years ago
Mike Fährmann	5cac79c3d9	[erolord] remove extractor	5 years ago
Mike Fährmann	b9cbf932b4	[pixiv] update URL patterns (fixes #568) ... Pixiv now uses new URLs for - user profiles and illustration listings: - https://www.pixiv.net/en/users/<ID> - https://www.pixiv.net/en/users/<ID>/artworks - bookmarks: - https://www.pixiv.net/en/users/<ID>/bookmarks/artworks	5 years ago
Mike Fährmann	988cc2ec23	[mangadex] change domain to mangadex.cc (closes #559)	5 years ago
Mike Fährmann	f8e137d6b4	[deviantart] show warning about private deviations only once ... … per call to '_pagination()'	5 years ago
Mike Fährmann	939fec8ecd	[deviantart] match new search/popular URLs (closes #538)	5 years ago
Mike Fährmann	09cc88b715	[deviantart] match '/favourites/all' URLs (closes #555)	5 years ago
Mike Fährmann	3811fd8a25	fix time formatting for Python 3.4 and 3.5 ... 'datetime.time.isoformat()' only has an optional 'timespec' argument since Python 3.6.	5 years ago
Mike Fährmann	43ab9572b4	[twitter] handle API rate limits (#526)	5 years ago
Mike Fährmann	569747a78d	implement extractor.wait()	5 years ago
Mike Fährmann	5532e9c158	[twitter] handle quoted tweets (#526) ... … and categorize them as retweets	5 years ago
Mike Fährmann	0b4cb8e57a	[mangahere] send 'isAdult' cookie (fixes #556)	5 years ago
Mike Fährmann	1afb91363c	[imagefap] generalize URL patterns and add tests (#552)	5 years ago
Xope Totec	f701e9f33a	Handle beta.imagefap.com URLs (#552)	5 years ago
Mike Fährmann	ce54b8c04c	let extractors opt-out of cookie option usage ... useful to avoid sending unnecessary cookies when all authentication is done through OAuth tokens	5 years ago
Mike Fährmann	5ad92fc196	[newgrounds] fix tags metadata extraction	5 years ago
Mike Fährmann	82f7f4172a	update test results	5 years ago
Mike Fährmann	1f2a69f3c5	add '_extractor' information to redirect results	5 years ago
Mike Fährmann	a27f43dad1	[pixiv] wait and retry after rate limit error (closes #535)	5 years ago
Mike Fährmann	6b373cb7e2	[exhentai] restrict default directory name length (#545)	5 years ago
Mike Fährmann	b347bf68c7	[deviantart] add extractor for followed users (#515)	5 years ago
Mike Fährmann	c0f391a4e2	[pixiv] support listing followed users (#515)	5 years ago
Mike Fährmann	896896a490	[twitter] fix URLs forwarded to youtube-dl (closes #540) ... Since commit 3bba763 data["user"] is an entire dict object and no longer just the user nickname …	5 years ago
Mike Fährmann	1e2713b895	[artstation] fix search result pagination (closes #537)	5 years ago
Mike Fährmann	bf3df3d0b0	[directlink] send Referer headers (closes #536)	5 years ago
Mike Fährmann	9be7ff600e	[imagetwist] replace test image ... the old one expired, it seems	5 years ago
Mike Fährmann	66905b1664	[foolslide] add fallback for chapter data extraction	5 years ago
Mike Fährmann	48e42e73fb	[reddit] change default value for 'comments' to '0'	5 years ago
Mike Fährmann	9c0928457a	[reddit] fix errors with 't1_…' submissions	5 years ago
Mike Fährmann	bf658fd84b	[vsco] implement 'videos' option	5 years ago
Mike Fährmann	95c90722ee	[instagram] implement 'videos' option (closes #521)	5 years ago
Mike Fährmann	d0920e84e9	update test results	5 years ago
Mike Fährmann	8c11e81c9f	Merge commit '63e6993716db8d8bedfb7b0d445c7161493046b6'	5 years ago
Mike Fährmann	63e6993716	merge 'bypost' functionality into metadata postprocessor	5 years ago
Mike Fährmann	31a29835ff	[realbooru] simplify extractors and update tests (#514)	5 years ago
The Oddball	9a4ce20b8e	[realbooru] Add Realbooru extractor (#514)	5 years ago
Mike Fährmann	72b8fbfbad	[instagram] make post-page extraction nonfatal	5 years ago
Mike Fährmann	922b8a9595	[weibo] raise NotFoundError for unavailable/deleted statuses	5 years ago
Mike Fährmann	0cd157300e	[patreon] fix regex pattern for posts ... The previous one would match the first number in the URL slug as post ID, which would fail for posts with numbers in their title.	5 years ago
Mike Fährmann	fe19e233f3	[xvideos] improve ... - derive from GalleryExtractor - match '…-channels' URLs - "better" metadata structure	5 years ago
Mike Fährmann	d3e44e899d	raise NotFoundErrors for 404 responses in GalleryExtractors	5 years ago
Mike Fährmann	a4dd8b3dab	improve _check_cookies() ... Only loop over all cookies once instead of calling cookiejar._find() for each cookie name.	5 years ago
Mike Fährmann	76e60d10a6	[patreon] raise proper exception if creator/post doesn't exist	5 years ago
Mike Fährmann	9e63804347	[patreon] make retrieving user info nonfatal (#508) ... … and fall back to the included data if an error occurs.	5 years ago
Mike Fährmann	964dc57286	[vsco] improve image resolutions ... https://im.vsco.co/ URLs redirect to the appropriate CDN server and occasionally insert a '/1200x1600/' into the image path, limiting image dimensions. This commit constructs redirect targets out of the given im,vsco.co URLs without sending extra HTTP requests and without any "builtin" resolution restrictions.	5 years ago
Mike Fährmann	0629fe8fa4	[vsco] fix user profile extraction … again ... Given the pattern from last time, collections will also change in due time and use cursor-based pagination.	5 years ago
Mike Fährmann	ab17ea9632	[deviantart] only print warning if 'original' is enabled	5 years ago
Mike Fährmann	2188db6284	[gelbooru] fix non-API tag extraction	5 years ago