219c4cc78c
[formatter] allow for numeric list and string indices
5 years ago
7d1da614d9
[formatter] implement field name alternatives ( #525 )
...
The format string '{a|b|c}' will now try to use the value from 'a' and
fall back to 'b' and 'c' if accessing a field raises an exception or
if its value is None.
5 years ago
67ea80222c
link to post processor example in 'pixiv.ugoira' docs
5 years ago
74e684e828
[twitter] change default value for 'videos' to 'true'
...
Every other 'videos' option defaulted to 'true', except Twitter.
5 years ago
ab13f81fd7
add example to 'cookies' docs
5 years ago
c7cf9dd111
[furaffinity] support classic layout ( #284 )
5 years ago
138135c190
[furaffinity] add extractors ( #284 )
5 years ago
b9c574bd1d
[patreon] log skipped files ( #590 )
5 years ago
80ea9104b8
[8kun] adjust URL pattern
5 years ago
c76c8b765a
[cloudflare] unescape challenge URL
5 years ago
ce26070231
[pixiv] reduce calls to '/user/detail'
5 years ago
da0d5f6092
[oauth] add 'port' option ( #604 )
5 years ago
719b63d0ca
[bcy] add user and post extractors ( #592 )
5 years ago
091f9a107d
[docs] add examples of how to filter manga chapters by language
...
(closes #599 )
5 years ago
6426e3efc7
[khinsider] fix and improve metadata extraction
5 years ago
4a3d2405de
[postprocessor:ugoira] small optimization
...
Use tuples instead of lists when extending the list of
command-line arguments.
5 years ago
b7eb6cecbb
[pixiv] handle tags at the end of new bookmark URLs
5 years ago
109f6c8685
[patreon] filter duplicate files per post ( #590 )
5 years ago
b38cf59711
[sexcom] fix image URLs & parse 'date' fields
5 years ago
1f4c9c5f9d
[8kun] add thread and board extractors ( closes #582 )
5 years ago
facc5daa6d
[twitter] force old login page layout ( fixes #584 , fixes #598 )
5 years ago
d1de7dc296
[hitomi] implement workaround for "broken" redirects
...
Some galleries redirect to a new "version" with different gallery id.
This new version might not be available any more, but the /reader/
page for the original gallery id can still work.
5 years ago
40fe062851
[pixiv] fix user id for bookmarks API calls ( closes #596 )
5 years ago
91aaaf1a9e
[pixiv] add 'rating' metadata field ( #595 )
...
A human-friendlier representation of 'x_restrict'
5 years ago
dff33b260c
[reddit] add 'videos' option
5 years ago
2ad43618cc
[piczel] fix extraction
5 years ago
cf7a67d67f
[yaplog] remove module
...
Yaplog! ended its service on 2020-01-31
5 years ago
e0dd073ce0
[twitter] replace embedded tweet test
...
the old one was deleted
5 years ago
ec36df4851
[deviantart] fix video extraction from 'extended_fetch' results
...
DeviantArt is now serving videos from wixmp servers (1), instead of
the former film00.deviantart.com (2), even though those URLS are still
functional.
They seem to also have re-encoded those videos. The 10 MB 1080p video
from (2) is now only available in 720p at ~20 MB (with a higher
bitrate, but still …). Other videos are still available in 1080p, but
not this one for some reason.
(Changing the '720p' in (1) to '1080p' doesn't work.)
(1) https://wixmp-ed30a86b8c4ca887773594c2.wixmp.com/v/mp4/9feaa2c9-1baf-4fc2-84f7-f3384b34cefe/d5gxnb5-282a2e9a-b552-40ff-8542-b3c5eed823f5.720p.a837d7cec12c41be8ca2ee53152cea3a.mp4
(2) https://film00.deviantart.net/4c1d/v/mp4/2012/279/d/1/_video____brushes_i_use_in_paint_tool_sai_by_chi_u-d5gxnb5.mp4
5 years ago
48be2266ed
[deviantart] better error message for 'extended_fetch' ( #585 )
5 years ago
383795b550
prevent superfluous calls to Logger.makeRecord()
...
… by setting an appropriate minimal logging level for the root Logger.
5 years ago
71851a6241
[pixiv] update URLs of followed users to the new format
5 years ago
d086f30b42
[reddit] restore archive keys for i.redd.it images
5 years ago
56f1c96168
implement 'parent-directory' option ( #551 )
5 years ago
ae07f92f7e
[reddit] rewrite extractor logic ( closes #551 )
...
Handle images and videos hosted on Reddit "natively",
allowing them to use reddit-specific metadata to build directory
and file names.
5 years ago
2852691d78
[paheal] replace test URL
...
searching for 'k-on' doesn't yield any results anymore
5 years ago
2a9be48511
improve util.load/save_cookiestxt() and add tests
...
- take a file object as argument instead of an filename
- accept whitespace before comments (" # comment")
- map expiration "0" to None and not the number 0
5 years ago
e35c2ea1a6
[weibo] use youtube-dl to download from m3u8 manifests
5 years ago
6703b8a86b
[blogger] implement video extraction ( closes #587 )
5 years ago
b3b5754f2d
update test_cookies.py
5 years ago
c1a6862863
implement functions to load/save cookies.txt files ( closes #586 )
...
The methods of the standard libraries' MozillaCookieJar have
several shortcomings (#HttpOnly_ cookies, 0 expiration timestamps, etc.)
and require construction of an ultimately pointless CookieJar object.
5 years ago
5d73b7f29c
release version 1.12.3
5 years ago
37247dbaff
miscellaneous fixes
5 years ago
0e9dc5c88e
fix AttributeError when accessing 'temppath'
...
[ci skip]
5 years ago
25d5ec4ff3
[twitter] add option to extract TwitPic embeds ( #579 )
5 years ago
254f7c3999
implement a post-processor module to compare file versions
...
(#530 )
5 years ago
32d7195d08
[pinterest] improve detection of invalid pin.it links
5 years ago
0b84068d84
remove temp files before downloading from fallback URLs
...
otherwise the next call to download() with a fallback URL could see
the partially downloaded "remains" from the previous, failed download
attempt and "continue" it, writing the second half of a potentially
different version of that file.
5 years ago
760b9b4db4
add remove_file() and remove_directory() helpers
...
these functions call os.unlink() or os.rmdir()
while catching and suppressing potential OSErrors
5 years ago
b2d542ad40
improve PathFormat._enum_file()
...
open only one try-except block for the whole loop,
instead of one for each iteration in os.path.exists()
5 years ago
Mike Fährmann