ff841d1f7b
update link to Chrome cookie export extension
...
see bbe8cc6662
4 years ago
df9e40ab35
small updates to release.sh
...
- use git push --atomic
- update VM name
- rename (git|pypi)-upload
4 years ago
d781e6ac44
[e621] return pool posts in order ( closes #1195 )
...
… and add a 'num' enumeration index.
A bit more code than the PR version, but it prints some helpful messages
and doesn't call 'metadata()' twice.
4 years ago
e7d446a8f7
[danbooru] slight code refactoring
4 years ago
e41e2be2f9
[booru] split '_prepare_post()'
4 years ago
53222445d5
[hentaicafe] simplify default filenames
4 years ago
712c792fbe
[hentaicafe] prefer title of /hc.fyi/ pages ( closes #1106 )
4 years ago
2c4d4a75db
[mangadex] respect 'chapter-reverse' settings ( closes #1194 )
...
The extractor in question doesn't inherit from MangaExtractor
and therefore didn't do this automatically.
4 years ago
3bd08acc8f
[pixiv] output debug message on failed login attempt
...
(#1192 )
4 years ago
b58e605dc7
raise error when required username or password are missing
...
do not try to login as 'None' (#1192 )
4 years ago
b233531aaa
[sankaku] use '/posts' endpoint for single posts
4 years ago
459a0af4f8
[sankaku] add support for sankaku.app URLs ( closes #1193 )
4 years ago
371e9ca6df
[pinterest] implement video support ( closes #1189 )
4 years ago
537742c0ee
[sankaku] normalize 'created_at' metadata ( closes #1190 )
4 years ago
ae6748996a
[pornhub] update tests
4 years ago
bf629a2818
[instagram] add 'include' option ( closes #1180 )
...
Split the functionality of the old 'user' extractor into separate
'posts' and 'highlights' extractors, which respond to virtual URLs
('/<user>/posts' and '/<user>/highlights')
4 years ago
78061658ea
[booru] reduce exceptions caught during _prepare_post()
...
don't catch HttpErrors etc.
4 years ago
212ae0c399
[mangapanda] remove module
...
site now redirects to mangareader.net
4 years ago
337b118e25
[instagram] warn about private profiles ( #1187 )
4 years ago
e8c64dd961
[postprocessor:exec] do not auto-add '{}' to command ( #1185 )
...
This was initially done to mimic youtube-dl's behavior and
implementation of --exec, and it seemed reasonable at the time.
4 years ago
0a3bbc9c63
[postprocessor:exec] update output
4 years ago
511d8d3fa3
increase SQLite connection timeouts ( #1173 )
4 years ago
465015f75a
[sankaku] reimplement login support ( #1176 , #1182 )
4 years ago
8d2e4e5f13
[booru] improve error handling
...
e.g. for posts without a valid 'file_url' (#1176 )
4 years ago
1f9121fecb
release version 1.16.0
4 years ago
1d753542c2
[hentainexus] fix extraction ( fixes #1166 )
4 years ago
b6f1fe59cb
add deprecation warnings for exec.final and metadata.bypost
4 years ago
1e59aa6123
update README.rst and setup.py
...
- remove superfluous '-'s
- use definition list for config paths
- add Python 3.9 support to setup.py classifiers
4 years ago
b8f2e42f7a
update pip install instructions
4 years ago
476d563ec2
[downloader:http] add MIME type and signature for .swf files
4 years ago
a00b60fbe7
[twitter] update 'x-csrf-token' header ( fixes #1170 )
...
Twitter started using a bigger (80 instead of 16 bytes) CSRf token for
logged in users, and expects those to be used as 'x-csrf-token' header
when send via 'ct0' cookie.
Generating an 80 byte token ourselves doesn't work, and Twitter will
still insist on using its own.
4 years ago
b88c97b873
[instagram] add 'cursor' option ( #1149 )
...
To enable at least 'some' way to continue downloading from the middle
of a user profile listing.
4 years ago
0d406c8daf
[common] restrict values used in 'generate_extractors()'
4 years ago
fe0265c7a5
[downloader.http] small improvements to file signature list
...
- specify multiple entries for gif, mp3, zip
- add entries for pdf
4 years ago
b2c55f0a72
[sankaku] remove login support
...
The old login method for 'https://chan.sankakucomplex.com/user/login '
and the cookies it produces have no effect on the results from
'beta.sankakucomplex.com'.
4 years ago
7f3d811d7b
[moebooru] inherit from BooruExtractor
4 years ago
a3a863fc13
[booru] add generalized extractors for *booru sites
...
similar to cc15fbe7
4 years ago
5f23441e12
[piczel] update API URLs
4 years ago
47114339a2
[webtoons] update 'ageGate' cookie
4 years ago
4225f12783
[nozomi] handle empty 'date' fields ( fixes #1163 )
4 years ago
2b93515ee0
[instagram] reimplement support for stories ( #1149 )
4 years ago
ecdea799dd
[sankaku] use 'beta.sankakucomplex.com' API endpoints
4 years ago
b3ecc89a9a
[instagram] use double quotes for strings when possible
4 years ago
76285eb60d
[instagram] reimplement support for story highlights ( #1149 )
4 years ago
8ca7f54750
rename '_request_…' variables
...
- remove '_' at the beginning
- _request_last -> request_timestamp
4 years ago
15a122aff3
[instagram] update 'X-IG-WWW-Claim' headers
4 years ago
e5d81bdc7b
[mangadex] handle 'external' chapters ( closes #1154 )
4 years ago
447488fb18
[instagram] rewrite
...
(#1113 , #1122 , #1128 , #1130 , #1149 )
Rely on the results of GraphQL queries instead of requesting data
for each post separately via '/p/<shortcode>/?__a=1'.
This might result in some missing metadata, and there might be some
issues for '/channel/' and '/saved/' URLs, but at least downloading
from the regular post listings should work without issues and without
getting users blocked/banned.
TODO: reimplement support for stories
4 years ago
cc15fbe71a
[moebooru] add generalized extractors for moebooru sites
...
- add support for sakugabooru.com (closes #1136 )
- add support for lolibooru.moe (closes #1050 )
This allows users to dynamically add support for moebooru/myimouto
based sites by adding an entry to their config file
(like for foolslide, foolfuuka, etc)
For example:
{
"extractor": {
"moebooru": {
"new-site-1": {"root": "https://site1.net "},
"new-site-2": {"root": "https://www.site2.moe "}
}
}
}
4 years ago
43120407cc
[paheal] create directory for each post ( closes #1147 )
4 years ago
Mike Fährmann