25074aec47
[twitter] fetch media from pinned tweets ( #1203 )
4 years ago
2475176d99
[twitter] fetch tweets from 'homeConversation' entries
...
When logged in, some entries returned by Twitter's API are so called
'homeConversation's (they would be regular tweet entries otherwise.)
Those weren't picked up before and resulted in missing files compared
to accessing a timeline as guest.
('/media' timelines and search results were not affected)
4 years ago
3af9350648
[twitter] update API calls
...
- use 'https://twitter.com/i/api ' for all requests
except '/guest/activate.json'
- update (default) URL parameters
- update GraphQL endpoints
4 years ago
b656b829db
[twitter] fix login with username & password
...
It is no longer possible to get an 'authenticity_token' from Twitter's
Javascript-free login form, which got disabled few days ago.
Generating a random 16 byte hex string client-side and sending that as
a cookie alongside the regular login form works just as well.
4 years ago
d1903589a5
release version 1.16.1
4 years ago
912eea29bc
update extractor test results
4 years ago
47a7a51944
[sankaku] fix 'invalid_token' detection
4 years ago
ba5df84f7e
[keenspot] improve redirect handling
...
Before it would use http:// for all requests and
get a redirect to a https:// version if those are supported.
Now the redirect only happens once during the first request.
4 years ago
ff841d1f7b
update link to Chrome cookie export extension
...
see bbe8cc6662
4 years ago
df9e40ab35
small updates to release.sh
...
- use git push --atomic
- update VM name
- rename (git|pypi)-upload
4 years ago
d781e6ac44
[e621] return pool posts in order ( closes #1195 )
...
… and add a 'num' enumeration index.
A bit more code than the PR version, but it prints some helpful messages
and doesn't call 'metadata()' twice.
4 years ago
e7d446a8f7
[danbooru] slight code refactoring
4 years ago
e41e2be2f9
[booru] split '_prepare_post()'
4 years ago
53222445d5
[hentaicafe] simplify default filenames
4 years ago
712c792fbe
[hentaicafe] prefer title of /hc.fyi/ pages ( closes #1106 )
4 years ago
2c4d4a75db
[mangadex] respect 'chapter-reverse' settings ( closes #1194 )
...
The extractor in question doesn't inherit from MangaExtractor
and therefore didn't do this automatically.
4 years ago
3bd08acc8f
[pixiv] output debug message on failed login attempt
...
(#1192 )
4 years ago
b58e605dc7
raise error when required username or password are missing
...
do not try to login as 'None' (#1192 )
4 years ago
b233531aaa
[sankaku] use '/posts' endpoint for single posts
4 years ago
459a0af4f8
[sankaku] add support for sankaku.app URLs ( closes #1193 )
4 years ago
371e9ca6df
[pinterest] implement video support ( closes #1189 )
4 years ago
537742c0ee
[sankaku] normalize 'created_at' metadata ( closes #1190 )
4 years ago
ae6748996a
[pornhub] update tests
4 years ago
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
4 years ago
78061658ea
[booru] reduce exceptions caught during _prepare_post()
...
don't catch HttpErrors etc.
4 years ago
212ae0c399
[mangapanda] remove module
...
site now redirects to mangareader.net
4 years ago
337b118e25
[instagram] warn about private profiles ( #1187 )
4 years ago
e8c64dd961
[postprocessor:exec] do not auto-add '{}' to command ( #1185 )
...
This was initially done to mimic youtube-dl's behavior and
implementation of --exec, and it seemed reasonable at the time.
4 years ago
0a3bbc9c63
[postprocessor:exec] update output
4 years ago
511d8d3fa3
increase SQLite connection timeouts ( #1173 )
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
8d2e4e5f13
[booru] improve error handling
...
e.g. for posts without a valid 'file_url' (#1176 )
4 years ago
1f9121fecb
release version 1.16.0
4 years ago
1d753542c2
[hentainexus] fix extraction ( fixes #1166 )
4 years ago
b6f1fe59cb
add deprecation warnings for exec.final and metadata.bypost
4 years ago
1e59aa6123
update README.rst and setup.py
...
- remove superfluous '-'s
- use definition list for config paths
- add Python 3.9 support to setup.py classifiers
4 years ago
b8f2e42f7a
update pip install instructions
4 years ago
476d563ec2
[downloader:http] add MIME type and signature for .swf files
4 years ago
a00b60fbe7
[twitter] update 'x-csrf-token' header ( fixes #1170 )
...
Twitter started using a bigger (80 instead of 16 bytes) CSRf token for
logged in users, and expects those to be used as 'x-csrf-token' header
when send via 'ct0' cookie.
Generating an 80 byte token ourselves doesn't work, and Twitter will
still insist on using its own.
4 years ago
b88c97b873
[instagram] add 'cursor' option ( #1149 )
...
To enable at least 'some' way to continue downloading from the middle
of a user profile listing.
4 years ago
0d406c8daf
[common] restrict values used in 'generate_extractors()'
4 years ago
fe0265c7a5
[downloader.http] small improvements to file signature list
...
- specify multiple entries for gif, mp3, zip
- add entries for pdf
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
7f3d811d7b
[moebooru] inherit from BooruExtractor
4 years ago
a3a863fc13
[booru] add generalized extractors for *booru sites
...
similar to cc15fbe7
4 years ago
5f23441e12
[piczel] update API URLs
4 years ago
47114339a2
[webtoons] update 'ageGate' cookie
4 years ago
4225f12783
[nozomi] handle empty 'date' fields ( fixes #1163 )
4 years ago
2b93515ee0
[instagram] reimplement support for stories ( #1149 )
4 years ago
ecdea799dd
[sankaku] use 'beta.sankakucomplex.com' API endpoints
4 years ago
Mike Fährmann