f500b45b5e
[twitter] improve 480bc34e
...
only check for double user assignment where necessary
1 year ago
480bc34e54
[twitter] do not overwrite previously assigned users ( #3922 )
1 year ago
f5a59c4170
[twitter] add 'date_bookmarked' metadata ( #3816 )
1 year ago
1c1f6fdc80
[twitter] fix regression from 160335ad
...
Tweets from 'homeConversation' or 'conversationthread' entries do not
contain a 'sortIndex' field. Accessing it raises a KeyError and would
erroneously get them labeled as 'deleted'.
1 year ago
160335ad44
[twitter] add 'date_liked' metadata for liked Tweets ( #3816 )
1 year ago
6d850ce629
[twitter] calculate 'date' from Tweet IDs
...
20 times faster than parsing 'created_at'
1 year ago
dbe06cdba1
[twitter] warn about 'withheld' Tweets and users ( #3864 )
1 year ago
3cc1dd1572
[twitter] update query hashes
1 year ago
3846ce0de5
[twitter] update to bookmark timeline v2 ( #3859 )
1 year ago
e6cb92864a
[twitter] allow setting custom features per API endpoint
1 year ago
bebbff6578
fix: graphql_timeline_v2_bookmark_timeline cannot be null
...
twitter: 400 Bad Request (The following features cannot be null: graphql_timeline_v2_bookmark_timeline)
1 year ago
197882cf12
[twitter] add 'hashtag' extractor ( #3783 )
2 years ago
2bb937014f
[twitter] fall back to legacy /media endpoint when not logged in
2 years ago
b68094d326
[twitter] support 'note_tweet's
2 years ago
3dcabc97ed
[twitter] update API endpoints and parameters
2 years ago
9037128315
[twitter] fix some 'original' retweets not downloading ( #3744 )
2 years ago
dd884b02ee
replace json.loads with direct calls to JSONDecoder.decode
2 years ago
1ae48a54f8
[twitter] add 'transform' option
2 years ago
ab58c375b4
[twitter] fix search ( #3536 )
...
- partially revert 18fe4b334d
2 years ago
9683d79bb7
[twitter] "fix" search pagination ( #3536 , #3534 )
...
- properly process instructions
- do not expect a predetermined instruction order
2 years ago
4fec848858
[twitter] use "browser": "firefox" by default ( #3522 )
...
and reenable TLS 1.2 ciphers
2 years ago
78937564fd
[twitter] fix login after 32b03433
2 years ago
32b0343334
[twitter] refresh guest tokens ( #3445 , #3458 )
2 years ago
26c3292538
[twitter] disable TLS 1.2 ciphers by default ( #3522 )
2 years ago
18fe4b334d
[twitter] remove 'tweet_search_mode' from search parameters ( #3522 )
...
and update API root and general query parameters
2 years ago
2f31d21509
merge #3455 : [twitter] apply tweet type checks before uniqueness check
2 years ago
30a31836e7
merge #3449 : [twitter] force HTTPS for TwitPic URLs
2 years ago
e18482e9ae
[twitter] improve 'http' -> 'https' replacement
2 years ago
4fd6da474f
merge #3473 : [twitter] fix crash when using 'expand' and 'syndication'
2 years ago
6933727b45
merge #3483 : [twitter] implement 'syndication=extended'
2 years ago
ed2d715019
fix 'keywords' in extractor tests ( #3491 )
2 years ago
6853b14be3
[twitter] apply suggestions from code review
...
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2 years ago
7c8eab8d52
[twitter] implement 'syndication=extended'
...
to be able to fetch extended user metadata
2 years ago
be3286206a
[twitter] assume 'conversation_id' when using syndication
...
not possible to expand replies at the momemt
2 years ago
ce8dbb1ccc
[twitter] fix crash when using 'expand' and 'syndication'
...
caused by KeyError: 'conversation_id_str'
2 years ago
38786a9593
[twitter] refactor extraction of TwitPic URLs
...
flattening
2 years ago
250d35107c
[twitter] prioritize tweet type checks ( #3439 )
...
Do not consider a tweet seen before applying 'retweet', 'quote' and
'reply' checks. Otherwise the original tweets will also be skipped if
the "derivative" tweets and the original tweets are from the same user.
2 years ago
3eb352fcb0
[twitter] force HTTPS for TwitPic URLs
2 years ago
90a9c0790f
[twitter] update 'search' pagination ( #544 )
...
Only stop when list of all returned Tweets is empty
instead of when no valid Tweet was found.
2 years ago
3082544fff
misc fixes
...
- fix typo (#3399 )
- remove double assignment
- [bunkr] update things I forgot in 6b6f886d#3388 )
2 years ago
cd931e1139
update extractor test results
2 years ago
0e75358af8
[twitter] fix using user IDs for suspended accounts
2 years ago
a24dcbe802
[twitter] fix login ( #3220 )
...
Using an email as 'username' seems to no longer be possible,
as Twitter will always additionally ask for username or phone number
when providing an email address as 'username'.
2 years ago
08fd1ff835
[twitter] add 'avatar' and 'background' extractors ( #349 , #3023 )
2 years ago
6c153750fa
[nitter] add extractors for Nitter instances ( #2696 )
2 years ago
15cd114c9c
[twitter] update bookmarks pagination ( #3172 )
...
Do not stop when there aren't any tweets in a batch,
but only when the same cursor value appears twice in a row.
2 years ago
b0cb4a1b9c
replace 'text.extract()' with 'text.extr()' where possible
2 years ago
9d3f86dbcd
[twitter] update URL for syndication API ( #3160 )
...
Twitter changed the URL format to access tweet data through their syndication API.
2 years ago
e99a9b2aff
[twitter] improve 'cards-blacklist' ( #2875 )
...
allow blacklisting domains and 'name:domain',
where 'domain' depends on a card's 'vanity_url' value
2 years ago
aaf6992bae
[twitter] fix new-style '/card_img/' URLs
2 years ago
Mike Fährmann