1626 Commits (5bcc7184c9a4572d91a62f7b7de730292e62fbbb)

Author	SHA1	Message	Date
Mike Fährmann	5bcc7184c9	[danbooru][e621] increase page limits	5 years ago
Mike Fährmann	90d15e3682	[instagram] use 'itertools.chain()'	5 years ago
Leonardo Taccari	160328d21c	[instagram] Add support for user's saved medias (#644) ... * [instagram] Gracefully handle possible 'HttpErrorPage' in _extract_page() `HttpErrorPage' is returned in shared_data at least when not authenticated or when trying to fetch other users saved medias (i.e. `instagram.com/<user>/saved/'). Gracefully handle it by returning nothing. * [instagram] Add support for user's saved medias (Please note that this need the user to be authenticated and they can only see their saved media (not other users ones).) Close #643. * [instagram] Bump copyright year	5 years ago
Mike Fährmann	d3482ace7f	[furaffinity] extract more metadata ... - views - favorites - comments - rating - fa_category (since 'category' is already in use) - theme - species - gender - width - height	5 years ago
Mike Fährmann	fdd2dd5136	[kabeuchi] add 'user' extractor (closes #561)	5 years ago
Mike Fährmann	59edcdc822	[hitomi] restore metadata fields from before f33b13a ... ... and add a 'metadata' option to disable visiting the gallery page and extracting data from it if this is not needed.	5 years ago
Mike Fährmann	2d5703c493	[twitter] use a simpler data structure to store cookies in cache ... Use a dict with name-value pairs instead of an entire RequestsCookieJar object.	5 years ago
Mike Fährmann	87d4f83597	[newgrounds] make post extraction nonfatal	5 years ago
Mike Fährmann	823fbeaae6	[newgrounds] add 'favorite' extractor (#394)	5 years ago
Mike Fährmann	a45fbc38ea	[pixiv] implement 'avatar' option (#595, #623)	5 years ago
Mike Fährmann	a63a376ad2	[mangoxo] fix login	5 years ago
Mike Fährmann	ebc70e87ce	[e621] update to new interface / API endpoints (closes #635)	5 years ago
Mike Fährmann	d1cf7ccdb3	[instagram] add 'post_shortcode' metadata field (#525)	5 years ago
Mike Fährmann	32df8d06fe	[twitter] add 'bookmark' extractor (closes #625)	5 years ago
Mike Fährmann	3fb41c34c8	[bcy] reduce requests to '/item/detail/<id>' (#613) ... The former implementation would try to use the embedded data from '/item/detail/' pages for every post, even if that wasn't really necessary. This commit also fixes some issues with posts only visible to logged in users.	5 years ago
Mike Fährmann	f33b13aacf	[hitomi] simplify metadata extraction ... Use the data from https://ltn.hitomi.la/galleries/<id>.js for both image URLs and metadata and ignore any gallery or reader pages. This removes 'artist', 'characters', 'group', and 'parody' metadata fields since this information is, as for now, only available in gallery pages.	5 years ago
Mike Fährmann	ce5e2a58fe	[imgbb] update test results ... Image server domain changed from https://image.ibb.co/ to https://i.ibb.co/	5 years ago
Mike Fährmann	f117e32910	[danbooru] restore 'popular' functionality	5 years ago
Mike Fährmann	39b48d665b	[hiperdex] use proper name for 'chapter_minor'	5 years ago
Mike Fährmann	8fbbaa54ff	[bcy] fix partial image URLs (#613) ... Images from new posts can have incomplete/partial URLs (1) without any filename extension when fetching their data from '/apiv3/user/selfPosts', so now all data gets taken from '/item/detail/ID' pages. It is currently unknown how to get the non-watermarked original version of these images, or if that is possible at all. (2) Images with a watermark will have their 'filter' metadata field set to "watermark". For original images this field is an empty string "". Enabling the 'noop' option will, in addition to the watermarked version, yield the the '~noop.image' filter version (3), where 'filter' is set to "noop". (1) "https://img-bcy-qn.pstatp.com/banciyuan/3ccdff22479c4060aadc86718209b281" (2) "https://p1-bcy.byteimg.com/img/banciyuan/3ccdff22479c4060aadc86718209b281~tplv-banciyuan-logo-v3:wqnpnLLlhZLlpKfprZTnjotfCuWNiuasoeWFgyAtIEFDR-eIseWlveiAheekvuWMug==.image" (3) "https://p1-bcy.byteimg.com/img/banciyuan/3ccdff22479c4060aadc86718209b281~noop.image"	5 years ago
Mike Fährmann	86c00f9e66	[danbooru] move extractor logic from booru.py	5 years ago
Mike Fährmann	1d4a369ea2	update extractor test results	5 years ago
Mike Fährmann	7625912b31	[piczel] improve and update ... - fix tag names - fix a bug in _pagination() - parse datetime in 'created_at' as 'date' - rewrite main loop - replace user profile test	5 years ago
Mike Fährmann	913b8333cc	write DeviantArt refresh-tokens to cache (#616) ... Writing the token is currently disabled by default and must be enabled with 'extractor.oauth.cache'. 'extractor.deviantart.refresh-token' must be set to '"cache"' to use the cached token.	5 years ago
Mike Fährmann	2a4f227e08	warn about expired cookies	5 years ago
Mike Fährmann	4e361b3008	add tests for specific datetime values	5 years ago
Mike Fährmann	80ecb99089	[hitomi] fix extraction	5 years ago
Mike Fährmann	247c9e1416	[vsco] update gallery URL pattern	5 years ago
Mike Fährmann	19ae6f3fc4	update test results ... - twitter: Don't test the whole kwdict, only the actual content, since the keyword hash changes whenever that user changes his display name. - khinsider: Download host changed	5 years ago
Mike Fährmann	cc5079c844	[hiperdex] add chapter and manga extractors (closes #606)	5 years ago
Mike Fährmann	64bdec8430	[deviantart] check availability of intermediary URLs (fixes #609)	5 years ago
Mike Fährmann	5607dd3646	[hitomi] follow multiple redirects	5 years ago
Mike Fährmann	765b2a0527	[hentaihand] add extractors (closes #605)	5 years ago
Mike Fährmann	d94215d119	[tumblr] replace '-' with ' ' in tag searches (fixes #611) ... To search for tags with actual minus signs in them (there shouldn't be too many,) manually replace those with url-encoded minus characters ('-' -> '%2d') before inputting them into gallery-dl: https://s679874.tumblr.com/tagged/tag-with-minus -> https://s679874.tumblr.com/tagged/tag%2dwith%2dminus	5 years ago
Mike Fährmann	e6cd49e78b	update extractor test results	5 years ago
Mike Fährmann	5d9437b398	[vsco] skip "invalid" entities	5 years ago
Mike Fährmann	650f2b6d58	[furaffinity] accept sfw.furaffinity.net URLs (closes #608) ... Just as an alias for regular URLs with no extra content filtering.	5 years ago
Mike Fährmann	74e684e828	[twitter] change default value for 'videos' to 'true' ... Every other 'videos' option defaulted to 'true', except Twitter.	5 years ago
Mike Fährmann	c7cf9dd111	[furaffinity] support classic layout (#284)	5 years ago
Mike Fährmann	138135c190	[furaffinity] add extractors (#284)	5 years ago
Mike Fährmann	b9c574bd1d	[patreon] log skipped files (#590)	5 years ago
Mike Fährmann	80ea9104b8	[8kun] adjust URL pattern	5 years ago
Mike Fährmann	ce26070231	[pixiv] reduce calls to '/user/detail'	5 years ago
Mike Fährmann	da0d5f6092	[oauth] add 'port' option (#604)	5 years ago
Mike Fährmann	719b63d0ca	[bcy] add user and post extractors (#592)	5 years ago
Mike Fährmann	6426e3efc7	[khinsider] fix and improve metadata extraction	5 years ago
Mike Fährmann	b7eb6cecbb	[pixiv] handle tags at the end of new bookmark URLs	5 years ago
Mike Fährmann	109f6c8685	[patreon] filter duplicate files per post (#590)	5 years ago
Mike Fährmann	b38cf59711	[sexcom] fix image URLs & parse 'date' fields	5 years ago
Mike Fährmann	1f4c9c5f9d	[8kun] add thread and board extractors (closes #582)	5 years ago