93 Commits (bc7b1d91bcbafe9f1736de6c0d9883ebd9e44170)

Author	SHA1	Message	Date
Mike Fährmann	968d3e8465	remove '&' from URL patterns ... '/?&#' -> '/?#' and '?&#' -> '?#' According to https://www.ietf.org/rfc/rfc3986.txt, URLs are "organized hierarchically" by using "the slash ("/"), question mark ("?"), and number sign ("#") characters to delimit components"	4 years ago
Mike Fährmann	1686dc1757	[twitter] support media from Cards (#1005, #937) ... Can be enabled with 'extractor.twitter.cards', but for now disabled by default because cards can redirect to rather large videos from YouTube or Twitch.	4 years ago
Mike Fährmann	a3ca2f6080	update fallback URL handling ... remove Message.Urllist and use a '_fallback' field inside a kwdict	4 years ago
Mike Fährmann	1b1cf01d0d	add a general 'generate_csrf_token()' function	4 years ago
Mike Fährmann	844502cad5	update extractor test results	4 years ago
Mike Fährmann	430b6d6e2e	[twitter] extend 'retweets' option (closes #1026) ... Setting 'retweets' to '"original"' will use metadata from the original retweeted Tweets, and not from the Retweet entry.	4 years ago
Mike Fährmann	aeb0d32333	[twitter] improve twitpic extraction (fixes #1019) ... - ignore twitpic.com/photos/… URLs - ignore empty image URLs	4 years ago
Mike Fährmann	2b8d57f0ab	[twitter] support '/intent/user?user_id=…' URLs (#980)	4 years ago
Mike Fährmann	a3b473bd2f	[twitter] support specifying users by ID (#980) ... by using 'id:…' as their screen name, i.e. https://www.twitter.com/id:2976459548/media instead of https://twitter.com/supernaturepics/media The user ID can, for example, be obtained from the output of $ gallery-dl -j --range 1 https://twitter.com/<screen-name>	4 years ago
Mike Fährmann	8f64585ff2	[twitter] handle 429 responses without x-rate-limit-reset header	4 years ago
Mike Fährmann	2da71cb561	[twitter] raise proper exception if user doesn't exist (#891)	4 years ago
Leonardo Taccari	86e5a05e29	[twitter] add support for nitter.net URLs in pattern (#890) ... Please note that URLs are only "translated", all requests are still done always via the Twitter API.	4 years ago
Mike Fährmann	3855d0dd3c	[twitter] add debug messages for all skipped Tweets (#867)	4 years ago
Mike Fährmann	6e2af9a8d8	[twitter] improve error message formatting	4 years ago
Mike Fährmann	9da2bc67f8	[twitter] add option to filter media from quoted tweets (#854)	4 years ago
Mike Fährmann	56ab5fb8f4	[twitter] improve handling of quoted tweets (#854) ... Split each "quote" into two parts: - the original tweet - the tweet that quoted the original	4 years ago
Mike Fährmann	a8c2d997e8	[twitter] treat quoted tweets like retweets (#833) ... - filter them when 'retweets' is disabled - set 'author' to the creator of the quoted tweet like it was before the rewrite	4 years ago
Mike Fährmann	aed1c63e51	[twitter] improve search results (fixes #847) ... Adding 'tweet_search_mode=live' to the query parameters is the most important part here.	4 years ago
Mike Fährmann	d81a8e6544	[twitter] update tests	4 years ago
Mike Fährmann	d39eedd9bb	[twitter] improve handling of deleted tweets (fixes #838)	4 years ago
Mike Fährmann	dc16f73965	[twitter] move '_guest_token()' into TwitterAPI class	4 years ago
Mike Fährmann	3561d1020a	[twitter] always provide an 'author' field (#831, #833) ... The idea was to have less metadata clutter for most Tweets were 'author' and 'user' are the same (non-retweets), and only provide a 'user' field. The original Tweet author could be gotten with {author[…]|user[…]}, but basically no one knows about that.	4 years ago
Mike Fährmann	c37a1c06c8	[twitter] add extractor for liked tweets (closes #837) ... You need to be logged in to get access to anyone's liked tweets, it seems.	4 years ago
Mike Fährmann	b94394104c	[twitter] don't download video previews (#833) ... when 'videos' is set to False	4 years ago
Mike Fährmann	036a40943a	[twitter] don't cache results of 'user_by_screen_name()' ... A 'keyarg=1' argument to the memcache decorator would have worked as well, but keeping the user object in memory isn't useful for the vast majority of use cases and only wastes space. (closes #817)	4 years ago
Mike Fährmann	4442dfe7b8	[twitter] add 'reply_to' metadata to replies	4 years ago
Mike Fährmann	d769bb4b80	[twitter] improve pagination	4 years ago
Mike Fährmann	5bc1097f9d	[twitter] metadata cleanup #2 ... - remove useless clutter by creating new tweet-data dicts instead of reusing the original Tweet objects - rename fields to how they were named before ('id_str' -> 'tweet_id', etc.) - only include 'author' if it would differ from 'user' - restore 'archive_fmt'	4 years ago
Mike Fährmann	3eed5f52d7	[twitter] small metadata cleanup ... - add 'date' field - remove 'entities' and 'extended_entities' - don't include 'focus_fields' from 'original_info'	4 years ago
Mike Fährmann	655c98cbef	[twitter] skip unavailable tweets	4 years ago
Mike Fährmann	2132e5461a	[twitter] restore TwitPic support	4 years ago
Mike Fährmann	bd0f21478a	[twitter] login using the mobile nojs login page	4 years ago
Mike Fährmann	a10f31dde5	[twitter] rewrite; use new interface (#740, #806) ... Everything except logging in with username & password and TwitPic embeds should be working again. Metadata per Tweet is massively different than before (mostly raw API responses - might need some cleaning up) and the default 'archive_fmt' changed.	4 years ago
Mike Fährmann	45baa13615	update extractor test results ... - don't run Instagram tests on Travis anymore - replace Twitter test because timeline was made private - update Hiperdex domain to '.com' (again ...)	4 years ago
Mike Fährmann	9f638c2e01	[twitter] add 'replies' option (closes #705)	4 years ago
Mike Fährmann	d3b3b30107	update test results	4 years ago
Mike Fährmann	3eab07739f	[twitter] ensure videos have a 'filename' ... This usually gets set when invoking the 'ytdl' downloader, but when that fails, the error message would use 'None' as filename.	4 years ago
Mike Fährmann	c4371a6970	[twitter] add 'reply' metadata field (#705)	4 years ago
Mike Fährmann	d02f7c1118	improve Extractor.wait() ... - allow 'until' to be a datetime object - do "time calculations" with UTC timestamps - set a default 'reason'	5 years ago
Mike Fährmann	b607d0ad7f	[twitter] fix typo in 'x-twitter-auth-type' header (#625)	5 years ago
Mike Fährmann	2d5703c493	[twitter] use a simpler data structure to store cookies in cache ... Use a dict with name-value pairs instead of an entire RequestsCookieJar object.	5 years ago
Mike Fährmann	32df8d06fe	[twitter] add 'bookmark' extractor (closes #625)	5 years ago
Mike Fährmann	19ae6f3fc4	update test results ... - twitter: Don't test the whole kwdict, only the actual content, since the keyword hash changes whenever that user changes his display name. - khinsider: Download host changed	5 years ago
Mike Fährmann	74e684e828	[twitter] change default value for 'videos' to 'true' ... Every other 'videos' option defaulted to 'true', except Twitter.	5 years ago
Mike Fährmann	facc5daa6d	[twitter] force old login page layout (fixes #584, fixes #598)	5 years ago
Mike Fährmann	e0dd073ce0	[twitter] replace embedded tweet test ... the old one was deleted	5 years ago
Mike Fährmann	25d5ec4ff3	[twitter] add option to extract TwitPic embeds (#579)	5 years ago
Alice	f498a9057f	[twitter] Fix stop before real end (#573) ... * [twitter] Fix stop before real end Fix for https://github.com/mikf/gallery-dl/issues/544. Makes sure that it really reached the end by checking that both "min_position" is null and "has_more_items" is false before stopping. * [twitter] Fix stop before real end (update)	5 years ago
Mike Fährmann	43ab9572b4	[twitter] handle API rate limits (#526)	5 years ago
Mike Fährmann	5532e9c158	[twitter] handle quoted tweets (#526) ... … and categorize them as retweets	5 years ago