23 Commits (7d5415c2017440c05046eb53c79f0c9e292235a6)

Author	SHA1	Message	Date
Mike Fährmann	57fc6fcf83	replace '24*3600' with '86400' ... and generalize cache maxage values	9 months ago
Mike Fährmann	a453335a9f	remove test results in extractor modules ... and add generic example URLs	1 year ago
Mike Fährmann	a383eca7f6	decouple extractor initialization ... Introduce an 'initialize()' function that does the actual init (session, cookies, config options) and can called separately from the constructor __init__(). This allows, for example, to adjust config access inside a Job before most of it already happened when calling 'extractor.find()'.	1 year ago
Mike Fährmann	d97b8c2fba	consistent cookie-related names ... - rename every cookie variable or method to 'cookies_*' - simplify '.session.cookies' to just '.cookies' - more consistent 'login()' structure	1 year ago
Mike Fährmann	b0cb4a1b9c	replace 'text.extract()' with 'text.extr()' where possible	2 years ago
Mike Fährmann	b03ca7f10c	[aryion] provide correct 'date' independent of dst	3 years ago
Mike Fährmann	4b3e309b90	[aryion] update/improve pagination (#1849) ... Manually increment the 'p' query parameter, instead of relying on a "Next" link which only works up to page 200.	3 years ago
Mike Fährmann	266ed9b62e	[aryion] add 'tag' extractor (closes #1849)	3 years ago
Mike Fährmann	0f35aca728	[aryion] minor code updates	3 years ago
Mike Fährmann	2eb46452ad	[aryion] update 'needle' to not skip text posts (fixes #1568) ... on "Latest Updates" pages "class='thumb scrollthumb' href='/g4/view/" and "class='thumb' href='/g4/view/" both end with "thumb' href='/g4/view/"	3 years ago
Mike Fährmann	387fe415d5	unescape items in text.split_html()	4 years ago
Magnus Boman	522d0a834c	[aryion] Unescape paths too (#1414) ... Without this you'll get paths like this: - Starcross - Ch. 2 "The Ins and Outs of Sarah" This commit changes it to: - Starcross - Ch. 2 "The Ins and Outs of Sarah"	4 years ago
Mike Fährmann	968d3e8465	remove '&' from URL patterns ... '/?&#' -> '/?#' and '?&#' -> '?#' According to https://www.ietf.org/rfc/rfc3986.txt, URLs are "organized hierarchically" by using "the slash ("/"), question mark ("?"), and number sign ("#") characters to delimit components"	4 years ago
Mike Fährmann	bc48514d84	[aryion] get post ID via gallery-item (fixes #981, closes #982) ... this even works when fetching post IDs from '/latest.php?id='	4 years ago
ArtaxIsSleeping	0e941553ec	[aryion] Add username/password support (#960) ... * Add username/password support to aryion extractor * Update docs to match * Fix code style	4 years ago
Mike Fährmann	b2009ea39e	[aryion] update folder mime type list (fixes #945)	4 years ago
Mike Fährmann	f1ddbff0b5	[aryion] add 'recursive' option (fixes #832) ... This is enabled by default and will recursively go through all (sub)folders in an artist's gallery. The old method of using "Latest Updates" lists can be restored by disabling this option.	4 years ago
Mike Fährmann	db6685eeae	[aryion] support downloading from folders (fixes #694)	4 years ago
Mike Fährmann	cf4cef3d63	[aryion] adjust 'date' to UTC time	5 years ago
Mike Fährmann	6c531be294	[aryion] fix malformed 'last-modified' headers (#390)	5 years ago
Mike Fährmann	dc65f7d8dc	[aryion] use generic download URLs (#390) ... i.e. /g4/data.php?id=… - get filename & extension from Content-Disposition header - handle all downloadable file types (docx, swf, etc)	5 years ago
Mike Fährmann	96b78bcf04	[aryion] include path in default directory format (#390)	5 years ago
Mike Fährmann	6143050980	[aryion] add gallery and post extractors (#390, #673)	5 years ago