1d14928bd9
[twitter] ignore previously seen Tweets ( #2712 )
...
occurs primarily for /with_replies results when logged in
2 years ago
4b2a0a0eda
[twitter] implement 'strategy' option ( #2712 )
...
to be able to better control what Tweets get used an returned
for twitter.com/USER URLs.
2 years ago
7b073bf9ef
Revert "[twitter] improve strategy for user URLs ( #2665 )"
...
'user_tweets_and_replies' was a mistake
2 years ago
d6c6c8a4a0
[twitter] improve '"replies": "self"' ( #2665 )
...
If a username is given in the input URL,
only download from replies by that user.
2 years ago
9c8d895d19
[twitter] implement 'csrf' option ( #2676 )
2 years ago
08db8435f1
[twitter] fix pagination for conversion tweets
...
a relic from the switch to GraphQL API
2 years ago
1da3ccf608
[twitter] implement 'expand' option ( #2665 )
2 years ago
0add1fc090
[twitter] improve strategy for user URLs ( #2665 )
...
- use '/with_replies' when appropriate
- consider 'text-tweets'
- build search query as necessary
2 years ago
da0696e1f5
recognize vxtwitter URLs ( #2621 )
2 years ago
dcb580240d
[twitter] extract alt texts as 'description' ( closes #2617 )
2 years ago
915dba8345
[twitter] improve results for regular user URLs
...
- continuation of 3346f58ahttps://twitter.com/USER/tweets )
although there should be no need to ever do that
2 years ago
9df4e0f65b
[twitter] disable 'cards' by default
2 years ago
3346f58a2a
[twitter] use twMediaDownloader strategy for user URLs
...
- use media timeline + search for default user URLs like
https://twitter.com/SCREEN_NAME
- fetches all/most media for the type of twitter URL that most users
use with gallery-dl
- can be disabled by setting 'strategy' to any truthy value,
like "timeline"
2 years ago
ad5a4b1756
[twitter] fix various syndication issues
...
- handle retweets
- fix videos without dimensions in URL (3e942a58#2499 )
2 years ago
3e942a58be
[twitter] improve syndication video selection ( #2354 )
...
- ignore .m3u8 manifests
- always select largest format
2 years ago
4527a35aba
[twitter] accept fxtwitter.com URLs ( #2484 )
2 years ago
1171911dc3
[twitter] add 'syndication' option ( #2354 )
...
to fetch age-restricted content using Twitter's syndication API
3 years ago
2aa47e8382
[twitter] handle Tweets with "softIntervention" entries
...
or other such things where the actual Tweet data is one level deeper
than usual
3 years ago
64bbc7969d
[twitter] warn about age-restricted Tweets ( #2354 )
3 years ago
e778be52bc
[twitter] update query hashes
3 years ago
4385a34e05
[twitter] fix handling of 429 responses ( fixes #2339 )
...
Twitter doesn't return a valid JSON response for 429 errors anymore.
3 years ago
bc0e853d30
combine KeyError & IndexError to common base class LookupError
3 years ago
0f1e7ff319
[twitter] fix extraction ( #2275 )
3 years ago
70e6e1549e
[twitter] provide fallback URLs for card images
...
f2e8aedd74 (commitcomment-64057751)
3 years ago
492436f936
[twitter] add 'warnings' option ( #2258 )
...
disable reporting any non-fatal errors by default
3 years ago
a5163e4c70
[twitter] restore 'logout' functionality ( #1719 )
3 years ago
d33227fc38
[twitter] restore errors for protected timelines etc ( fixes #2237 )
3 years ago
8230f31800
[twitter] update query hashes
3 years ago
c180806cec
[twitter] fix deleted/invalid retweets ( #2225 )
3 years ago
2bf554a896
[twitter] fix several errors ( #2212 , #2216 , #2225 )
...
- fix Tweets with deleted quotes
- fix suspended Tweets without 'legacy' entry
- fix unified_cards without 'type'
3 years ago
e5242b83bf
[twitter] define directory format for events ( #2109 )
3 years ago
5ed26e1773
[twitter] fix pinned tweets ( #2216 )
...
caused by the changes in dffa440ede
3 years ago
a9f78e6527
[twitter] improve error handling
...
- handle accounts without 'rest_id'
- handle timelines with empty 'instructions'
3 years ago
729b07c1f5
[twitter] simplify
...
- use dict with common GraphQL variables
- reduce 'variables' size with custom JSON encoder instance
- centralise TwitterAPI() creation
3 years ago
9ca8bb2dc0
[twitter] improve error handling
3 years ago
9a221494c3
[twitter] add 'event' extractor ( closes #2109 )
3 years ago
14867dad6b
[twitter] fix unified cards from search results
3 years ago
dffa440ede
[twitter] improve handling of deleted tweets ( #2212 )
3 years ago
54ef874ba4
[twitter] fix retweet filter ( #2212 )
3 years ago
cb43f7731b
[twitter] update to GraphQL API ( #2212 )
...
The old REST API endpoints, which were not used by Twitter since
summer 2021, are going to finally be phased out it seems, with
'/2/timeline/profile/USERID.json' being the first one.
Only Twitter's search doesn't have a GraphQL interface yet.
3 years ago
f2e8aedd74
[twitter] changes to 'cards' option
...
- change default value to 'true'
- only invoke youtube-dl for cards unsupported by gallery
when 'cards' is set to "ytdl"
"cards": true --> only download card images
"cards": "ytdl" --> download card images and
use youtube_dl on otherwise unsupported cards
3 years ago
df2f0c09bb
[twitter] support "image_carousel_website" unified cards
3 years ago
f587458a3c
[twitter] include '4096x4096' as a default image fallback
...
(closes #2107 , closes #1881 )
3 years ago
ab8eea1a24
[twitter] fix extractor for direct image links ( fixes #2030 )
3 years ago
4377f1c284
[twitter] distinguish between fatal & nonfatal errors ( #2020 )
...
only show a warning for nonfatal errors
and do not raise a StopExtraction exception
3 years ago
9156e90f1f
[twitter] add 'pinned' option
3 years ago
cd66c3c415
[twitter] add 'size' option ( #1881 )
3 years ago
94143eb86c
[twitter] add 'quote_by' metadata field ( #1481 )
...
Only present for tweets quoted by another tweet.
Represents the tweet_id of said tweet quoting this one.
3 years ago
da16eabb82
[twitter] ensure card entries have a 'url' ( #1868 )
3 years ago
0fd959a2a7
[twitter] support '/with_replies' URLs ( closes #1833 )
3 years ago
Mike Fährmann